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A STUDY OF THE RELATIONSHIP OF CER- 
TAIN COMPETENCIES TO SUCCESS IN 
TEACHING VOCATIONAL AGRICULTURE 


ANDREW PUMPHREY TORRENCE 
Tuskegee Institute 


SECTION I 


Statement of the Problem 





THE PURPOSE of this study is to ascertain 
the relationship between the success attained by 
vocational agriculture teachers and certaincom- 
petencies that these vocational agriculture teach- 
ers possess. In order to facilitate the achieve- 
ment of this purpose, four null hypotheses have 
been formulated. These hypotheses serve as a 
guide in planning the investigation, in determin- 
ing what data to collect, in classifying and or - 
dering the data, and in making the basic judg - 
ments necessary in this study. The four null 
hypotheses to be tested in this study are: 


1. There is no statistically significant relation- 
ship, as shown by coefficients of correlation, 
between a vocational agriculture teacher’s 
knowledge of technical agricultural informa- 
tion and his success as a teacher. 


. There is no statistically significant relation- 
ship, as shown by coefficients of correlation, 
between a vocational agriculture teacher’s 
proficiency in performing agricultural man- 
ipulative skills and his success as a teacher. 


. There is no statistically significant relation- 
ship, as shown by coefficients of correlation, 
between a vocational agriculture teacher's 
knowledge of professional educational infor- 
mation and his success as a teacher. 


. There is no statistically significant relation- 
ship, as shown by regression equations, be- 
tween a vocational agriculture teacher’s 
knowledge of technical agricultural informa- 
tion, proficiency in performing agricultural 





manipulative skills, and knowledge of pro- 
fessional educational information and his 
success as a teacher. 


Definition of Terms 


The definition of words and phrases given be 
low will generally apply wherever these words 
and phrases appear throughout this study. Wher- 
ever any of these terms are used in this study 
with meaning different from the definitions here 
given, the reader will be so informed. 


ie Competence —the level of efficiency, ability, 
or knowledge that one has achieved. 


. Manipulative skills—the ability to use one’s 
knowledge and intellect to perform tasks with 
the hands or by mechanical means. 


. Null hypothesis—a supposition that observed 
effects are due to chance factors and not to 
statistically significant relationships. 


. Professional education—that part of a teach 
er’s training that will give him an appreci- 
ation of and a knowledge of how best to teach 
his subject and influence desirable changes in 
his students. Professional education would 
concern itself with such things as the place of 
the school in our society, child growth and 
development, child psychology, guidance and 
measurement in education, and principles 
and methods of teaching. 


. Reiationship—a connection or link between 
two or more factors. Jt means that altera- 
tions in one or more factors occur along with 
alterations in one or more different factors. 


#The author wishes to express his sincere thanks and appreciation to many people whose assistance has 
been sought and secured in the development of this study, particularly Dr. W. T. Bjoraker, his major 
professor, Dr. B. We. Kreitlow, and Dr. A. S. Barr for constant direction, encouragement, and inspira- 


tion throughout the course of this investigation. 
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These changes may occur conversely, or 
they may occur in harmony with each other. 


. Teaching success—the degree to whicha 
teacher of vocational agriculture uses desir- 
able means to attain desirable ends in dis- 
charging his duties as a teacher. 





. Teacher training—those activities needed for 
assisting teachers or prospective teachers to 
secure the professional knowledge, abilities, 
understandings, and appreciations which will 
enable them to qualify for professional em - 
ployment or advancement in teaching voca- 
tional agriculture. This training is gereral- 
ly given in accredited colleges or universi- 
ties where agricultural education is taught. 





. Technical agriculture—the knowledge that 
one has concerning factual information on the 
production and management of livestock, 
crops, and soil. 





. Vocational agriculture—a nation-wide, feder- 
ally aided program of systematic instruction 
in agriculture and farm mechanics of less 
than college grade conducted in public schools 
or classes for persons over 14 years of age, 
for the purpose of training present and pros- 
pective farmers for proficiency in farming. 
This program in the individual states and 
schools must be conducted in conformity with 
Congressional Vocational Education Acts. (1) 





Background of the Study 





The program of vocational education of less 
than college grade in public schools of the Unit- 
ed States is of relatively recent development. 
It was developed in conformity with the provi- 
sions of Public Law No. 347 - Sixty-fourthCon- 
gress, approved February 23, 1917, usually re- 
ferred to as the Smith-Hughes Act. (1) Supple- 
mentary acts have been enacted from time to 
time. The latest of these is the Vocational Ed- 
ucation Act of 1946, commonly known as the 
George-Barden Act. These acts have been en- 
acted for the purpose of promoting and develop- 
ing vocational education through a plan for c o- 
operation between the federal government and 
the states. Vocational education in agriculture 
was encompassed in the first enabling act and 
it has been recognized and included in each suc- 
ceeding act. 

This plan of cooperation for the development 
of vocational education is based upon two funda- 
mental ideas: (1) that vocational education is a 
matter of national interest and essential to the 
' national welfare, and (2) that federal funds are 
necessary to stimulate and assist the states in 
making adequate provisions for such training. (1) 
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The primary aim of vocational education in 
agriculture is to train present and prospective 
farmers for proficiency in farming. Ithas been 
considered as one of the permanent phases of 
the public school program in rural areas. Voca- 
tional education in agriculture has been instru- 
mental in developing the skills, abilities, infor- 
mation, attitudes, understandings, and working 
habits of rural people which will enable them to 
enter employment in agriculture, or to make 
satisfactory advancement in farming occupations. 
It also, presumably, makes a contribution toward 
the development of good citizens, including their 
health, social, civic, and cultural interests. 

Under a plan of cooperation between state 
boards for vocational education and the United 
States Office of Education, vocational education 
in agriculture is a nation-wide, federally aided 
program of systematic instruction in agricul- 
ture and farm mechanics of less than college 
grade conducted in public schools or classes for 
those persons over 14 years of age who have en- 
tered upon or who are preparing to enter upon 
the work of the farm or of the farm home. The 
instruction is given by qualified teachers of vo- 
cational agriculture who are employed on a 12- 
month basis so as to follow-up their instruction 
throughout the year by assisting individuals and 
groups with their farming programs on the indi- 
vidual student’s farm. This provides ayear- 
round, uninterrupted program of instruction in 
agriculture. 

The major objectives of vocational education 
in agriculture are to develop effective ability to: 


. Make a beginning and advance in farming. 

. Produce farm commodities efficiently. 

. Market farm products advantageously. 

. Conserve soil and other natural resources. 
. Manage a farm business. 

. Maintain a favorable environment. (1) 


There are three well-recognized groups to 
be served by vocational agriculture, namely, 


1. In-school farm youth preparing to farm.. 
.2, Out-of-school young men engaged in farm - 
ing, usually on the farm or asa farm work- 
er looking forward to full establishment 
as an independent farm operator. 
. Adult farmers fully established as operat- 
ors either as owners or as tenants. 


Vocational education in agriculture has been 
considered as an integral part of public secon- 
dary school education and contributes to the gen- 
eral objectives and philosophy of such education. 
An examination of any recognized set of secon- 
dary school objectives with the intention of as - 
certaining what contributions vocational agricul - 
ture makes to them will readily prove the au- 
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thenticity of this claim. Cook (13) postulates 
how vocational education in agriculture provides 
many opportunities for the development of abili- 
ties essential to the seven cardinal principles of 
education. This writer made a study of ‘‘How 
the Vocational Agriculture Curriculum of Wis - 
consin Contributes to the Ten Imperative Needs 
of Youth as Listed by the Education Policies 
Commission. ’’ (45) He charted the needs of 
youth which various vocational agriculture sub- 
jects help to satisfy, and found that the voc a- 
tional agricultural curriculum of Wisconsin 
makes a very appreciable contribution to satis- 
fying these ten imperative needs. All ofthe im- 
perative needs get some contribution from vo- 
cational agriculture subjects, varying from a 
very little to considerable. The methodology of 
teaching, the knowledge of the subject, and the 
teacher himself are major factors in getting the 
imperative needs of youth satisfied. 

Vocational agriculture has served to elevate 
the level of economic stability, social stability, 
and general establishment of farm people in 
farming by teaching agriculture to high school 
farm boys, as well as by keeping the adult farm - 
ers aware of the latest and best scientific dis - 
coveries in farming. Without the instructional 
aid of this program, many young men would not 
have been able to begin or continue in farming 
successfully. The more successful vocationa |] 
agriculture teachers are, the more success ful 
farmers and farm communities will be in attain- 
ing desirable ends. This study is intended to 
reveal what relationship certain competencies 
have to the success of vocational agriculture 
teachers. 

One of the essential features is a good pro- 
gram of vocational education in agriculture is 
an adequate supply of competent teachers. This 
was recognized in the Smith-Hughes Act which 
provided specific funds for the training of teach- 
ers and required that in order to use the money 
provided for the salaries of vocational teachers, 
a state must expend a specified amount for the 
training of teachers. The George-Barden Act 
does not make a separate authorization of funds 
for this purpose, but it does state that the funds 
made available for the several vocational fields 
(which includes vocational agriculture) may be 
used for assisting the States and Territories in 
maintaining adequate programs of teacher train- 
ing. (1) 

Why some vocational agriculture teachers 
meet with great success while others attainonly 
mediocre success or fail is of great importance 
to teachers themselves, to state supervisors of 
vocational agriculture, to teacher training insti- 
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tutions, to high school vocational agriculture 
students, and to farmers. If the success of vo- 

cational agriculture teachers could be success- 

fully predicted before or shortly after he enters 
the field of teaching, it would save the time, en- 
ergy, and resources of the teacher and all who 

help train him. More important, it would pro- 
tect farming areas from ineffective vocational] 

agriculture teachers. 

The number of recent studies attacking var- 
ious phases of vocational agriculture teacher's 
success gives evidence of the gravity of this prob- 
lem.* It is easily recognized that unless voca- 
tional agriculture teachers are effective, the 
whole program of vocational agriculture can be 
of little value. Some studies concerned with 
causes for discontinued departments of voca - 
tional agriculture in high schools were reviewed 
by this writer. Three of these studies (35, 36) 
listed ineffective teaching as being one of the 
main causes for the vocational agriculture pr o- 
gram being dropped from the high school curric- 
ulum. 

In order to increase the effectiveness of vo- 
cational agriculture teachers, we must first dis- 
cover on what their success hinges. Many ofthe 
studies reviewed by this writer deal with pre - 
service training of teachers of vocational ag- 
riculture.. Although this study will reflect the 
significance of pre-service training, itis not 
primarily a pre-service training study. Itdeals 
directly with the in-service teachers and there- 
fore is considered a contribution that has not 
been made previously. 

In an article entitled ‘‘Impact of Research in 
Agriculture,’’ Byron T. Shaw (34) points out that 
agriculture faces a tremendous job in the next 
25 years. He states that ‘‘our population is now 
growing at the rate of 24 million a year, and the 
Census Bureau estimates that by 1975, under 
moderately favorable conditions, it will reach 
190 million. This means that American farmers 
will have to produce about 30 percent more by 
1975 if they are to provide adequately for all our 
people.’’ Most good land is already taken, so 
our greatest opportunity for meeting this in- 
creased population problem is in better use of 
the land we already have for farming purposes. 
This assumes greater efficiency in production 
on farms and improved distribution, utilization, 
and marketing after products leave the farm. Mr. 
Shaw writes, ‘‘The job ahead of us is to increase 
production wherever possible, to prevent de- 
clines in production, to cut waste and spoilage 
of goods during handling, and marketing, and 
in the home, and to make better use of agricul- 
tural products’’. 


“See Chapter II, "Review of Related Research," in original thesis on file in the Library of the Univer- 
sity of Wisconsin. 
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This article is principally concerned with re- 
search in technical agriculture and technical 
farming, however, we can easily infer from it 
the need for efficient teachers of vocational ag- 
ricuiture. Vocational agriculture teachers, 
along with other rural education agencies, have 
the tremendous responsibility and obligation not 
only to funnel the results of agricultural re- 
search to every farmer and farm home, but al- 
so to interpret these results so that they might 
be understood, appreciated, and profitably util- 
ized. 

In 1900 each American farmer produced 
enough to teed eight people. Today he produces 
sufficiently to feed 16 people, but itis estimated 
that by 1975 he will have to produce enough to 
feed 21 people. The successful vocational agri- 
culture teacher will do much to help the farmer 
accomplish this task. It is hoped that as a re- 
sult of this study, we will have some indications 
of whether or not certain competencies of voca- 
tional agriculture teachers are related to their 
Success 


Aspects of the Problem to be Investigated 


While the purpose of this study is to deter - 
mine the relationship between the success at- 
tained by vocational agriculture teachers and cer- 
tain competencies possessed by these teachers, 
more specifically, it will seek to find answers 
to the following questions; 


1. What relationship exists between a vocation- 
al agriculture teacher’s knowledge of tec h- 
nical agricultural information andhis success 
as a teacher? 


2. What relationship exists between a vocation- 
al agriculture teacher’s proficiency in per- 
forming agricultural manipulative skills and 
his success as a teacher? 


3. What relationship exists between a vocation- 
al agriculture teacher’s knowledge of pro- 
fessional educational information andhis suc- 
cess as a teacher? 


. What relationship exists between a vocation- 
al agriculture teacher's knowledge of tech- 
nical agricultural information, proficiency in 
performing agricultural manipulative skills, 
and knowledge of professional educational in- 
formation as a composite and his success as 
a teacher? 


Significance of the Study 
A perusal of the literature indicates that the 
competencies of vocational agriculture teachers 


that are being investigated in this study have not 
been assessed previously in relation to the suc- 





cess of vocational agriculture teachers. Little 
is known as to why some vocational agriculture 
teachers seem to be more successful than oth- 
ers. It is hoped that this study will reveal what 
relationships the above competencies have on 
the success of these teachers. This study should 
be a valuable tool for determining pre-service 
and in-service training needs of vocational agri- 
culture teachers. It will show whether or not 
there are wide-spread incompetencies of certain 
technical information, manipulative skill abil- 
ities, and professional knowledge of vocational 
agriculture teachers in Wisconsin, and how they 
relate to the success of these teachers. 

Wisconsin has long been regarded as a state 
of high achievement in agriculture and agricul- 
turaleducation. It is hoped that this study wil] 
set a pattern of procedure that can be followed 
in other states, and that it will permit other 
states making such a study in the future to com- 
pare their results with the findings of this study. 

Lastly, this whole field of vocational agricul- 
ture teacher success is still in need of muchser- 
ious research. This study will serve as a fore- 
runner for subsequent vocational agriculture 
teacher-success studies to be conducted at the 
University of Wisconsin. 


SECTION Il 
DESIGN OF THE STUDY 


THE COMPETENCIES of vocational agricul- 
ture teachers that are to be measured in this 
study are in the areas of technical agriculture, 
manipulative farm skills, and professional edu- 
cation. 

The group to be studied will bea randomsam - 
ple of sixty vocational agriculture teachers who 
teach in one man vocational agriculture de part- 
ments of public high schools located in appr ox- 
imately the southern two-thirds of the state of 
Wisconsin. 

Teacher success will be determined from rat- 
ings given to the vocational agriculture teachers 
by people who are in a position to know of the 
work of these vocational agriculture teachers. 
These ratings will be furnished by state super- 
visors, principals, pupils, and farmers in the 
local school and community in which each teach- 
er teaches. 


Description of the Subjects 





The subjects used in this investigation were 
a random sample of sixty high school teachers 
who teach vocational agriculture in one 
teacher departments located in approximate] y 
the southern two-thirds of the state of Wiscon- 
sin. More specifically, these teachers were 
drawn from the area between the upper limits 
of the county lines of St. Croix, Dunn, Chippe- 
wa, Clark, Marathon, Shawano, Brown, and 
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Kewaunee counties and the southern limits of 
the state of Wisconsin. (See Figure 1.) The to- 
tal population from which these teachers were 
drawn did not include vocational agriculture 
teachers who teach in vocational schools, and 
it did not include vocational agriculture teach- 
ers who teach in departments of vocational agri- 
culture that have two or more teachers. 

All of the vocational agriculture teachers who 
taught in one-man departments located within 
the area described above were listed alphabetic - 
ally by name. Numbers were assigned to this 
alphabetical listing, and a sample of 60 teach- 
ers were drawn by the use of Fisher and Yates’ 
table of random numbers. (19) There were 217 
teachers in the total population. 

Outof the sixty teachers chosen atrandom, 16 
were currently enrolled in summer school at the 
University of Wisconsin. There were 14 other 
vocational agriculture teachers enrolled in sum- 
mer school at the University who taught in one- 
man departments located in the area described 
above but those assigned numbers did not fall 
in the random selection. It was decided that if 
these 14 teachers did not differ significantly 
from the 16 teachers who were drawn in the 
random sample, they too could be used inthe 
study as a part of the random group. 

Pursuant to that decision, the two groups 
were analyzed with respect tothe following: (1) 
age, (2) training, (3) rearing (whether or not 
teachers were reared on a farm), (4) experience 
in teaching agriculture, (5) total student enroll- 
ment in high schools in which teachers taught, 
and (6) total vocational agriculture department 
enrollment in high school in which teachers 
taught. The results of this analysis are shown 
in Table I. 

The training of these teachers is very simi- 
lar. They all have a B.S. degree in agricultur- 
al education or its equivalent, and have done 
some post graduate work. One of the teachers 
has a M. S. degree in agricultural education. Ali 
of the teachers except one were reared ona 
farm. The one who was not has owned a farm 
in adult life. 

The statistical significance of the difference 
between means (24) for the two groups was cal- 
culated for the age, experience in teaching agri- 
culture, total high school enrollment, and total 
vocational agriculture department enrollment 
columns. It was decided that if these differ- 
ences were not significant at or below the .05 
level of probability, it could be assumed that 
these two groups were a part of the same total 
population. All differences proved non-signifi- 
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cant with the greatest difference being at the 159 
level of probability for the total high school en 
rollment column. Other differences were atthe 
90% level for age, the 65% level for experience 
in teaching agriculture, and the 40% level of 
probability for the total vocational agriculture 
department enroliment factors. 

Since the differences in these two groups are 
not significant at the levels describedabove, and 
since the 16 teachers were randomly drawn from 
the total population, it was assumed that the 14 
teachers who were in summer school but not 
drawn in the random selection could be cons id 
ered a part of the randomization, and they were 
therefore added to the subjects used in this study 
This gave a total of 30 teachers on the Universi- 
ty campus to be used in the study, and it left 30 
additional teachers to be selected who were not 
enrolled in summer school at the University of Wis 
consin. The remaining 30 teachers participating 
in this study who were not enrolledin summer 
school were chosen as their assigned numbers kp 
peared inthe random selectionproviding they 
were available for the testing program designed 
for this study. Allofthe 30 teachers inthe state 
whose assigned numbers were drawn in the ran 
dom selection were available for testing except 
six. One of these was sick, the other five were a 
way on vacation. When it occurred that six of the se 
lected teachers were not available for testing, the 
Six teachers assigned to the next numbers appea! 
ing in the table of random numbers were chosen 


Description of Data Gathering Devices 


1. Technical Agriculture Information 

Technical agriculture competency was meas 
ured by administering tests of factual informa 
tion in seven technical agriculture fields. These 
tests were in the areas of agronomy, dairy cat 
tle, farm management, horticulture, poultry, 
soils, and swine. Three of the tests were con 
structed by the writer with guidance and super 
vision from an expert in the field at the Univer 
sity of Wisconsin. * Three tests were adapted 
from a battery of tests on animal enterprises by 
Ivan G. Fay, State Supervisor of the Veterans 
On-Farm Training Program in Wisconsin. This 
battery is entitled ‘‘Mastery Tests in Animal 
Husbandry’’, and is published by the Interstate, 
Danville, Illinois. Experts at the University of 
Wisconsin also assisted in the adaptation of these 
tests for use in this study. ** Professor Edward 
J. Graul of the Soils Department of the Univer 
sity of Wisconsin prepared the test in soils. Com 
petency in feeds and feeding was determined by 


* Experts giving guidance and supervision to the construction of these tests were: Professor Re H. Andrew 
in agronomy; Professor Donald R. Mitchell in Farm Management; and Professor Malcolm N. Dana in horticul- 


ture. 


“vExperts assisting in this adaptation were: Professor James W. Crowley in dairy husbandry; Frofessor Rob- 
ert He Grummer in animal husbandry; and Professor James CG. Halpin in poultry. 
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FIGURE 1 
THE AREA FROM WHICH THE VOCATIONAL AGRICULTURE TEACHERS PARTICIPATING IN 


THIS STUDY WERE CHOSEN, AND THE DISTRIBUTION OF THE SCHOOLS IN WHICH 
THEY TAUGHT 
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Note: The heavy black line indicates the upper limits of the State from which participants in this 
study were chosen. 


The black dots indicate the location of the 60 schools in which participants in this study 
taught. 
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the incorporation of questions on this topic into 
the animal enterprise tests. 

In order to check the comprehensiveness of 
these tests, their coherence, and the approx- 
imate time required to take them, the original 
test drafts were administered to 11 upper class- 
men in the Department of Agricultural Educa - 
tion at the University of Wisconsin. (See Test 
drafts, Appendix A.)* In tabulating the respon- 
ses to this ‘‘trial run’’ testing, it was discov - 
ered that certain questions had to be deleted or 
revised because of inappropriateness. Some 
sections of the tests were revised in order to 
give consistency to the question design, to add 
speed in taking the tests, and to facilitate tabu- 
lation. The revised technical agriculture infor- 
mation tests were used in this study. (See Ap- 
pendix B.) There was no time limit for com - 
pleting these tests. 


2. Agricultural Manipulative Skills Information 

Competency in agricultural manipulative 
skills was measured by a survey (see Appendix 
C) of manipulative farm skills completed by each 
subject. This survey of skills was adapted 
from a survey used by Rhoad (32) to measure 
the comprehensiveness of abilities in technical 
agriculture attained by prospective teachers of 
vocational agriculture in Ohio previous to their 
entrance into student teaching. This survey was 
limited to 15 farm enterprises or areas of farm 
skills that would be of general use and applica- 
bility in all rural areas in the state of Wiscon- 
sin. Also, the skills under each enterprise or 
area were limited to those that were considered 
highly desirable for farm people toperform pro- 
ficiently. The areas included inthis survey are: 
dairy and beef cattle, poultry, Swine, corn, 
meadows and pastures, small grains, garden- 
ing, potatoes, fruit growing, concrete, electri- 
fication, farm machinery and power, erosion 
control, home beautification, and farm pl umb- 
ing. 

Each question in the survey was answered on 
a five-point rating scale as follows: 5) excel- 
lent, 4) good, 3) average, 2) poor, 1) no exper- 
ience. A high score indicated a high degree of 
proficiency in performing the skill. Definition 
of the terms (see Appendix C) usedin the rating 
scale were read by each subject so that all would 
have the same conception of the meaning of these 
terms in rating themselves. 

A memorandum (see AppendixC) to each sub- 
ject asked him to be objective in rating himself, 
to take his time (there was notime limit on this), 
and to rate himself on each item in the survey. 


3. Professional Education Information 
The measure of professional education com- 
petency of vocational agriculture teachers was 





accomplished by administering the Professional 
Information section of the 1951 edition of the Na- 
tional Teacher Examinations to all teachers par- 
ticipating in this study. Because of the highly 
confidential nature of these tests, and pursuant 
to directions from Mr. Arthur L. Benson, Di- 
rector of Teacher Examinations of the Educa- 
tional Testing Service, reproduction of these 
test questions cannot be included in this study. 
However, numerous references to the National 
Teacher Examinations can be found in the liter- 
ature (20, 16, 33,43), dating back to 1940 when 
they were first given. 

The National Teacher Examinations are pre- 
pared and administered annually by the Educa - 
tional Testing Service. They consist ofa battery 
of tests designed to measure the professional 
background, mental ability, and general cultur- 
al knowledge of candidates for teaching posi - 
tions (43). Only the Professional Information 
section of these tests was used in this study. Al- 
though this section yields a single score, it is 
composed of four parts. Each part of the 1951 
edition of the Professional Information sec tion 
of the test is timed; the total time allotted for 
taking this section is 75 minutes. There is a to- 
tal of 105 questions in this section of the test. 
The four parts of this section of the test, the num- 
ber of questions per part, and the time allotted 
per part are shown in Table Il. All questions 
were of the objective type, consisting of short 
answers involving multiple-choice responses. 

Since these examinations are revised annual- 
ly, the reliabilities of the various tests vary 
slightly from year to year. The objective of the 
Educational Testing Service is to maintain mini- 
mum Kuder-Richardson reliability coefficients 
of .85 for the Professional Information section 
and other sections of the tests. Because of the 
detailed item analysis data available to the Edu- 
cational Testing Service in constructing the tests, 
instances where they fail to meet this objective 
are rare. According to Mr. Benson, no part- 
score normative data are available for the 1951 
edition of this test. In Appendix D of this study 
is a leaflet of the ‘‘Interpretation of Scores’’ for 
the 1951 nation-wide administration of the Nation- 
al Teacher Examinations. This leaflet, furn- 
ished by Mr. Benson, gives some interpretative 
data that includes information on the Profession- 
al Information section of the test that was used 
in this study. 


4. Criteria of Success 

The measure of teacher success was deter- 
mined by ratings given to vocational agriculture 
teachers by state supervisors of vocational agricul - 
ture, principals, pupils, andfarmers in the local 
school and community in which each teacher taught. 


#All references to Appendices will be found in original thesis on file in Library, University of Wiscon- 
sin. 
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TABLE II 


THE PARTS OF THE PROFESSIONAL INFORMATION SECTION OF THE 1951 EDITION 
OF THE NATIONAL TEACHER EXAMINATIONS, THE NUMBER OF QUESTIONS 
PER PART, AND THE TIME ALLOTTED FOR TAKING EACH PART 





Parts of Professional Informa- No. of Time Allotted 
tion Section of 1951 Edition of Questions for Taking 
National Teacher Examination per Part Each Part 


Part I, Education as a 
Social Institution 21 15 minutes 





Part Il, Child Development 
and Educational Psychology 28 20 minutes 


Part Ill, Guidance and Meas- 
urement in Education y 20 minutes 


Part IV, General Principles 
and Methods of Teaching 20 minutes 


Total 75 minutes 
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The state supervisor of vocational agricul- 
ture in Wisconsin and his staff cooperatively 
gave a rating to each teacher used in this study. 
They used a five-point rating scale as follows: 
5) excellent, 4) good, 3) average, 2) below av- 
erage, and 1) poor. A high score indicated a 
high rating; a low score indicated a low rating. 

A short form of the Wisconsin Adaptation of 
the M-Blank (see Appendix E) was used by the 
principals to rate the vocational agriculture 
teachers in their schools. The rating under the 
item ‘‘General Evaluation’’ was used inthis 
study. The five-point scale and the indica- 
tions of the ratings were the same as those used 
for the supervisors. 

An adaptation of a form used by Anderson (3) 
was used in this study to secure pupil ratings 
of vocational agriculture teachers. Mr. Ander- 
son had adapted his pupil reaction to instruc- 
tion form from a pupil evaluation device devel- 
oped by Bryan. The all inclusive rating (see 
Appendix E) was the score used in this study. 
The five-point scale for this all inclusive rat- 
ing was: 5) best fifth, 4) second fifth, 3) mid- 
die fifth, 2) fourth fifth, and 1) poorest fifth. 
A high score indicated a high rating; and a low 
score indicated a low rating. 

A draft of a farmer rating scale (see Appen- 
dix F) was developed and administered to 15 
farmers in a nearby rural community. The re- 
turned ratings of these farmers were analyzed, 
and the rating scale was revised (see Appendix 
G) for use in this study. The overall evaluation 
(item 6) was the score used in this investigation. 
The five-point scale and the indications of the 
rating were the same as those used for the su- 
pervisors. 


Securing the Data 


1. Competencies of Vocational Agriculture 
Teachers 

Competencies of vocational agriculture teach- 
ers were measured by administering seven tests 
on factual information in technical agric ul ture, 
by administering a survey of manipulative skills 
in agriculture, and by administering a test on 
professional education information to the teach- 
ers participating in this study. Thirty of the 
participating teachers were enrolled inthe 1953 
summer school session at the University of Wis- 
consin. These several tests and the man- 
ipulative farm skills survey were administered 
to these teachers in a group on the campus of 
the University of Wisconsin in July, 1953. The 
remaining 30 teachers participating in this study 
were tested singly or in groups of twoat the high 
schools in which they taught. The tests were 
administered to these teachers in July and Aug- 
ust, i953. Because of the security hazard in - 
volved in administering the highly confidential 
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professional information examination, and inac- 
cordance with an agreement with Mr. Benson, 
Director of Teacher Examinations, Educational 
Testing Service, these tests were administered 
only in the presence of the writer, and under 
his continued supervision. 


2. Success of Vocational Agriculture Teachers 

Teacher success was determined from rat- 
ings given to the vocational agriculture teachers 
by state supervisors of vocational agriculture, 
principals, pupils, andfarmers. A list of the 
teachers participating in this study was given to 
the state supervisor of vocational agriculture in 
September, 1953. In October, 1953, the state 
supervisor and his staff completed a cooperative 
rating of each teacher on the lists, andthese rat- 
ings were used in the study. 

In May, 1953, high school principals were 
sent a form letter (see Appendix E) asking them 
to rate their vocational agriculture teacher, and 
to have five officers of the local FFA rate him 
on forms enclosed for that purpose. These com- 
pleted rating scales were returned in stamped 
self-addressed envelopes that were furnished by 
the writer. 

Five farmer ratings were used for each voca- 
tional agriculture teacher participating in this 
study. The names and addresses of the farmers 
were secured from a general information sheet 
(see Appendix C) that each participating teacher 
completed at the time that he took the tests. Each 
teacher listed 10 farmers in his local school 
community. The five most cooperative farmers, 
according to the vocational agriculture teacher, 
were sent a form letter (see Appendix G) in Aug- 
ust, 1953, asking them to rate the particular vo- 
cational agriculture teacher on a rating scale 
enclosed for the purpose. These completed rat- 
ing scales were returned in stamped self- ad- 
dressed envelopes that were furnished by the 
writer. 


Treatment of the Data 





As indicated earlier, seven different tests of 
technical agriculture were administered to teach- 
ers of vocational agriculture who participated in 
this study. These tests were in the areas of ag- 
ronomy, dairy cattle, farm management, horti- 
culture, poultry, soils, and swine. Also, afive- 
point rating scale survey of manipulative farm 
skills and a professional information test we re 
administered. The manipulative farm skills 
survey was divided into fifteen farm enterprises 
or areas of farm skills. Finally, there was the 
rating of the efficiency of each teacher by four 
groups of raters as follows: 


1. Rating of teacher by state supervisors. 
2. Rating of teacher by principal on the Wiscon- 
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sin Adaptation M-Blank (short form). supervisory rating scores a possible high of 
. Rating of teacher by pupils on an adaption of twenty-five and a possible low of five for each 
the Pupil Reaction to Instruction form used teacher, thereby, equating these scores withthe 
by Harold M. Anderson. pupil and farmer rating scores. Using these ad- 
. Rating of teacher by farmers on a Farmer justed scores, the following composites were 
Rating Scale. made for each participating teacher: 


Raw scores were used in all of the tabula- 1. Composite supervisory and principal 
tions. All of the individual scores on each test rating score. 
and on each enterprise or area of manipulative 2. Composite supervisory and pupil rat- 
farm skills survey were tabulated. After this ing score. 
was done, the following composites were made . Composite supervisory and farmer rat- 
for each participating teacher: ing score. 
. Composite principal and pupil rating 
1. Composite score made on the seven tests of score. 
technical agriculture. (Scores made on the . Composite principal and farmer rating 
four parts of the professional information score. 
test were originally recorded as a composite ). Composite pupil and farmer rating 
score. ) score. 
. Composite of the supervisory, princi- 
. Composite score made on the manipulative pal, pupil, and farmer ratings. 
farm skills survey. 
Scores made on the several tests used in this 
. Composite score made on the seven tests of study were intercorrelated. Scores made on the 
technical agriculture and the manipulative various enterprises or areas of the manipulative 
farm skills survey. farm skills survey were intercorrelated, and in- 
tercorrelations were secured among efficiency 
. Composite score made on the seven tests of rating scores. Intercorrelations were secured 
technical agriculture and the professional in- among the test scores and each efficiency rating, 
formation test. between each test score and all possible combin- 
ations of the ratings, as well as between a com- 
. Composite score made on the manipulative posite of the test scores and all possible combin- 
farm skills survey and the professional infor- ations of the rating scores. This same proc ed - 
mation test. ure was followed in running intercorrelations 
among the manipulative farm skills survey and 
. Composite score made on all testing devices; all the several ratings. Finally, intercorrela- 
seven tests of technical agriculture manipu- tions were secured among composite scores 
lative farm skills survey, and the profession- made on the seven tests of technical agriculture, 
al information tests. the manipulative farm skills survey, the profes 
sional educational information test, andthe ef 
Each rating on each participating teacher ficiency ratings. 
was tabulated. The principal ratings were se- From composite scores made on the tests in 
cured as a single score with a possible high technical agriculture, the manipulative farm 
rating of five and a possible low rating of one skills survey, and the professional educational 
foreachteacher. The supervisory ratings tests, multiple regression techniques will be em 
were secured in a similar manner. The five ployed to develop equations for predicting the 
pupil ratings were combined to make one score success of the vocational agriculture teacher. 
with a possible high rating of twenty-five and a Composites of ratings will be used as the criter- 
possible low rating of five for each teacher. ia of success. Finally, from the scores made 
The five farmer ratings were treated the same on selected tests in technical agriculture, se- 
as were the five pupil ratings. Then the prin- lected enterprises in the manipulative farm 
cipal and supervisory rating scores were adjust- skills survey, and in the professional education- 
ed to give them equal weight with the pupil and al information test, multiple regression tec h- 
farmer rating scores. The adjustment was ac- niques will be employed to develop equations 
complished by multiplying five times the prin- for predicting the success of the vocational ag- 
cipal’s rating score and five time the supervis- riculture teacher. Composites of ratings will 
or’s rating score. This gave the principal and be used as the criteria of success. 
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SEC TION III 


ANALYSIS OF DATA 


IN THIS SECTION, the statistical treatment 
of the data will be presented. Occasional refer - 
ence will be made to tables and to selected books 
for more detailed discussions of the data and 
methods employed in conducting this study. 

The Pearson product moment coefficient of 
correlation (30) will be used in this study to in- 
dicate linear relationships existing between var- 
ious sets of competency scores; between var - 
ious sets of success rating scores; and between 
various competency and rating scores. * 

Correlational data used in this study will be 
summarized with the use of observation, statis- 
tical significance of correlations (24), and re- 
gression equation techniques (12,44). Correla- 
tions that are not significant at or below the 5% 
level of probability will not be considered sta - 
tistically significant in this study. 

This section will be divided into five parts. 
Part one will deal with the percentages of right 
answers made on the tests in technical agricul- 
ture, the percentage scores made on the manip- 
ulative farm skills survey, and the percentages 
of right answers on the test in professional edu- 
cation. 

Part two will deal with the intercorrelations of 
success rating scores. Part three will be con- 
cerned with the intercorrelations of competency 
scores, while part four will deal with the cor- 
relations between competency scores and suc- 
cess rating scores. In part five the prediction 
of success will be considered. 


Competency Scores and Success Rating 


core Percentages 
1. Test in Technical Agriculture 

All tests in technical agriculture were de- 
signed and developed in similar manner. (See 
Section II. ) They all deal with basic and fundament- 
al factual material in their respective areas. Be- 
cause of these similarities, the various tests of 
technical agriculture are assumed to have ap - 
proximately equal difficulty and equal basic un- 
derstanding requirements. 

Table III indicates that the highest individual 
percentage score made on the test in technical 
agriculture was 96.3, made on the dairy cattle 
test. The mean percentage score on the dairy 


“The formila used in this computation was r = 
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cattle test was 75.3. The only mean percentage 
score that was higher than this was made on the 
poultry test. The mean percentage score on the 
poultry test was 76.1. 

The lowest individual percentage score, 32.9, 
was made on the soils test. The mean percent- 
age score on the soils test was 63.5. The only 
mean percentage score that was lower than this 
was made on the farm management test. The 
mean percentage score on the farm manage - 
ment test was 60. 7. 

Higher individual percentage scores were 
made on the animal enterprise tests, including 
dairy cattle, poultry, and swine, than was made 
on any other technical agricultural test. Also, 
the animal enterprise test shows a higher low 
percentage score than any other single test 
except the agronomy test. The low percentage 
score on the agronomy test was 59.2. Except 
for agronomy and horticulture, with mean per- 
centage scores of 75.1] and 75.0 respectively, 
the mean of the animal enterprise percentage 
scores was higher than it was for any other single 
test. 

Farm management and soils are rather simi- 
lar with respect to their mean, high, and low 
percentage scores. They have lower percentages 
of right answers in all three categories than any 
other single test. Soils has a higher mean and 
high score percentage right than farm ma nage- 
ment, while farm management has a higher low 
score percentage than soils. 

Agronomy and horticulture are very similar 
with respect to their mean, high, and low per- 
centage scores. 

On the basis of the assumption that these tests 
in technical agriculture have approximately 
equal difficulty and equal basic understanding re- 
quirements, these percentage scores have the 
following indications: (1) that vocational agr i- 
culture teachers in Wisconsin, from whom this 
sample was chosen, have a better knowledge of 
basic facts in animal enterprises than they have 
in other farming enterprises investigated in this 
study; (2) that vocational agriculture teachers in 
Wisconsin, from whom this sample was chosen, 
have less knowledge of basic facts in soils and 
farm management than they have in other areas 
of farm endeavor investigated in this study, (3) 
that vocational agriculture teachers in Wiscon- 
sin, from whom this sample was chosen, have 
less knowledge of basic facts in agronomy and 
horticulture than they have inanimal enterprises. 


NIXY - ©X- LY 





There were three as- 





¥V[ NDX? - (£X)?2][ NYY? - (LY)?] 
They were: (1) a linear relationship existed between 


sumptions made when computing these correlations. 


each set of variables, (2) all the variebles correlated had normal distributions, and (3) a line best 


fite its data when the sum of the squares of the devietions is a minimun. 
made on the basis of actual inspection of the data. 


accepted by mathematicians. 


Assumptions one and two were 
Assumption three is based on a principle generally 
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TABLE If 


THE MEAN, HIGH, AND LOW SCORES MADE BY TEACHERS OF AGRICULTURE ON THE 
VARIOUS MEASURES EXPRESSED AS PERCENTAGES 





= ee 


Mean High Low 
Scores Score Score 





Tests in Technical Agriculture 

. Agronomy 

. Dairy Cattle 

. Farm Management 

Horticulture 

Poultry 

Soils 

Swine 

Composite of all technical 
agriculture tests 


ROMMOOW> 


Il. Tests in Professional Education 


Ill. Manipulative Farm Skill Scores 

. Dairy and Beef Cattle 

. Poultry 

. Swine 

Corn 

. Meadow and Pasture 

Small Grain 

Gardening 

Potatoes 

Fruit Growing 

Concrete 

Electrification 

Farm Machinery and Power 
. Erosion Control 

. Home Beautification 

. Farm Plumbing 

. Composite of Manipulative Farm Skills 


A 
B 
C 
D. 
E 
F. 
G. 
H. 
I. 
J. 
K. 
L. 
M 
N 
oO 
P 


coconocooocooneoooow 


Composite of Individual Ratings of Teacher 
Success 





TABLE IV 


INTERCORRELATIONS OF INDIVIDUAL CRITERIA RATINGS OF VOCATIONAL AGRICULTURE 
TEACHER SUCCESS 





eS as 


Principal Farmer Supervisory Composite 


Pupil . 443 . 316 . 320 . 845 





Principal ibete 4 . 307 . 501 640 
Farmer ere xan . 488 . 018 


Supervisory 





14 JOURNAL OF EXPERIMENTAL EDUCATION 


However, their knowledge of basic facts in agron- 
omy and horticulture seem greater than their 
knowledge of basic facts in soils and farm man- 
agement. 

The mean composite percentage of right an- 
swers made on all tests in technical agriculture 
was 71.8. There is no normative data available 
as yet on these tests, and no acceptable criter- 
ion was found for evaluating this score. 


2. Test in Professional Education 

Competency in professional education was 
measured by administering the 1951 edition of 
the professional information section of the Na- 
tional Teacher Examination to all teachers who 
participated in this study. (See Section II.) 

Comparing the mean percentage score that 
the agriculture teachers made on this test (see 
Table III) with the mean scores and perc entile 
ranks shown in Appendix D, it appears that the 
vocational agriculture teachers participating in 
this study are less well professionally informed 
than were the teachers taking this examination 
in 1951. However, this comparison must be 
qualified and considered in terms of the number 
of people taking the national administration of 
the test in 1951 as compared to the number of 
teachers used in this study. 

This comparison can also be qualified in 
terms of the importance of this test to the indi- 
vidual teacher. Scores made on this test dur- 
ing the national administration of it appear very 
important to the person taking the test. Some 
school superintendents and boards of education 
require teaching applicants to submit scores 
made on the National Teacher Examinations to 
be evaluated as a part of their application. Al- 
so, the National Teacher Examinations are used 
as comprehensive examinations for undergrad- 
uates and as qualifying examinations for grad- 
uate students in some colleges. Because of the 
great importance of making high scores on the 
test, people taking the national administration 
of it in 1951 probably made special study and 
reviews of educational principles in preparation 
for taking the test. No such special prepara- 
tion was made by the teachers participating in 
this study. 

There is no data available for comparing 
scores made on the professional educational test 
by vocational agriculture teachers participating 
in this study with scores made on the same test 
by other vocational agriculture teachers. How- 
ever, there is data available that seem to indi- 
cate that vocational teachers tend to make lower 
scores On professional educational test than do 
teachers of academic subjects. Table V of the 
leaflet in Appendix D indicates that industrial 
arts majors and home economics majors who 
took the 1946-50 national administrations of the 
test made lower mean scores than did most 
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people who took the test during those years and 
who expressed teaching preferences other than 
in vocational subjects. 


3. Manipulative Farm Skills 

The manipulative farm skills score was se - 
cured with the use of a self-rating survey (see 
Section II), so the human factors inherent in rat- 
ing oneself must be considered in analyzing these 
scores. Definition of terms used in the rating 
scale (see Appendix C) accompanied each survey 
so that all participating teachers would have sim- 
ilar understandings of term meanings and there- 
by reduce some of the subjectivity. 

There does not appear to be any particular re- 
lationship among the mean, high, and low per- 
centage scores made on the various enterprises 
in the manipulative farm skills survey. This 
would indicate a rather wide diversity of individ- 
ual competencies in performing agricultural 
skills. 

Swine, which had the lowest mean percentage 
score of the animal enterprise tests under test 
in technical agriculture above, has the highest 
mean. percentage score of the animal enter- 
prises under the manipulative farm skills sur- 
vey. Dairy and beef cattle have the second high- 
est mean percentage score of the animal enter- 
prises under manipulative farm skills, and poul- 
try, which had the highest mean percentage 
score of the three under technical agricultural 
tests, has the lowest mean percentage score un- 
der manipulative farm skills. Judging by tests 
and skills used in this study, this would indicate 
that there is very little relationship between 
one’s knowledge of factual information in animal 
enterprises and his ability to perform animal en- 
terprise skills. Table V, which shows intercor- 
relations of competency scores supports this an- 
alysis. This table shows that scores made on 
the animal enterprise tests of technical agricul- 
ture have almost no correlation with the scores 
made on the animal enterprise manipulative 
skills. 


Intercorrelations of Rating Scores 





The intercorrelations of individual criteria 
ratings can be seen in Table IV. Similar in- 
structions were given each rater, and judging 
from the responses to the request for ratings, 
practically all raters cooperated readily. Al- 
though no reliability estimates of the raters 
used in the study were obtained, it is assumed 
that the ratings given each participating teacher 
was a valid and reliable opinion of the rater. 

The supervisory and principal ratings are 
more closely correlated than any other two rat- 
ings. The supervisory and farmer ratings are 
the second most closely correlated ratings 
while the principal and farmer ratings are the 
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lowest correlated ratings. All of the correla- 
tions are statistically significant. Thatis, the 
positive relationships that are indicated by the 
correlations are not due to chance alone. 


Intercorrelations of Competency Scores 





1. Test in Technical Agriculture 

Among the technical agricultural tests are a 
considerable number of statistically significant 
correlations; some are higher than others. Ta- 
ble V shows that the highest correlations are 
among the animal enterprise tests. Correla- 
tions of .735 between the swine and dairy cattle 
tests, .623 between the poultry and dairy cattle 
tests, and .576 between the swine and poultr y 
tests, are statistically significant at the .1% 
level. No other correlation is statistically sig- 
nificant at such a high level. 

Among the low correlations in the technic al 
agricultural test scores is noted the correlation 
of .084 between poultry and horticulture, .118 
between the dairy cattle and agronomy tests, 
and .169 between the swine and soils tests. 

There is a consistently positive correlation 
between all of the technical agricultural test 
scores. This indicates thatagriculture instruc - 
tors who ranked high on one test tendedto rank 
high on other tests, and agriculture instructors 
who ranked low on one test tended to rank low 
on other tests. 


2. Manipulative Farm Skills 

There are quite a number of negative correl- 
ations between the technical agricultural test 
scores and the manipulative farm skills survey 
scores. Table V shows that only one of the cor- 
relations between technical agricultural test 
scores and manipulative farm skills survey 
scores is statistically significant. This one 
is between the swine technical agricultural test 
and the swine manipulative farm skills. An ex- 
ample of a negative correlation between a tech- 
nical agricultural test score and a manipulative 
farm skills score is the correlation of -.125 be- 
tween the dairy and beef cattle manipulative 
skill and the agronomy test score. An example 
of a positive correlation between a technical 
agricultural test score and a manipulative farm 
skills score is the correlation of .057 between 
the poultry manipulative skill score and the 
agronomy test score. The consistently lowcor- 
relations between the manipulative farm skill 
scores and the technical agricultural test score 
indicate that there is very little relationship be- 
tween a vocational agriculture teacher’s know]l- 
edge of factual information in agriculture and 
his own judgment regarding his ability to per- 
form agricultural manipulative skills. 

Intercorrelations among the manipulative 
farm skill scores give consistently positive 
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correlations. Practically all of these manipula- 
tive farm skill score inter-correlations are sta- 
tistically significant. All intercorrelations of 
the animal enterprise manipulative farm skill 
scores are statistically significant at the .1% 
level. Most intercorrelations of the mechanical 
and farmstead type of manipulative farm skil}] 
scores are Statistically significant at the .1% 
level. 

The only correlations among the manipulative 
farm skill scores that are not statistically sig- 
nificant are between gardening and poultry, con- 
crete and gardening, erosion control and garden- 
ing, erosion control and potatoes, home beauti- 
fication and potatoes, home beautification and 
concrete, home beautification and electrification, 
and home beautification and swine. 

The consistently positive correlations among 
the manipulative farm skill scores indicate that 
agriculture teachers who ranked themselves high 
in performing one manipulative skill tended to 
rank themselves high in performing other man- 
ipulative skills. Also, agriculture teachers who 
ranked themselves low in performing one manip- 
ulative skill tended to rank themselves low in 
performing other manipulative skills. 


3. Professional Educational Test 

As shown in Table V, the professional educa- 
tion test scores correlate positively with all of 
the technical agriculture test scores. The cor- 
relation between scores made on the profession- 
al education test and the farm management test 
is statistically significant at the .1% level. 
There are statistically significant correlations 
at the .1% level between the professional educa- 
tion and the dairy cattle test scores; between the 
professional education and the poultry test scores; 
and between professional education and the swine 
test scores. The correlation between profes- 
sional education and the horticulture test score 
is statistically significant at the 5% level, while 
the correlations between professional education 
and the soils test score and between profession- 
al education and the agronomy test score are not 
statistically significant. 

All correlations between professional educa - 
tion test scores and manipulative farm skill 
scores are negative except one, and only one is 
Statistically significant. This gives the indica- 
tion that an agriculture teacher who ranked high 
on the professional education test tended to rank 
high on the technical agriculture test. Also, an 
agriculture teacher who ranked low on the pro- 
fessional education test tended to rank low on 
the technical agriculture test. It indicates that 
there is very little relationship between a voca- 
tional agriculture teacher’s knowledge of pro - 
fessional education information and his own 
judgment regarding his ability to perform man- 
ipulative farm skills. 
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TABLE V 


THE INTERCORRELATIONS OF AGE, YEARS OF TEACHING EXPERIENCE, TECHNICAL AGRICUL - 
TURE TEST SCORES, MANIPULATIVE FARM SKILL SCORES, PROFESSIONAL EDUCATION 
TEST SCORES, AND COMBINATIONS OF COMPOSITES OF COMPETENCY SCORES 


ee 








ae —— =e 


Tests in Technical Agriculture Manipulative Farm Skills 


Experience Teaching 
Farm Management 
Dairy and Beef Cattle 


Meadows and Pastures 


Agronomy 
Horticulture 
Poultry 

Composite 
Poultry 


Age 
Experience in Teaching 


Tests in Technical 
Agriculture 


Agronomy 057 
Dairy Cattle 028 
Farm Management 119 
Horticulture -101 
Poultry 052 
Soils 018 
Swine ‘ ; ; see 


183 
Composite 090 


ete Farm 


Skills 

Dairy and Beef Cattle 
Poultry 

Swine 

Corn 

Meadow and Pasture 
Small Grain 
Gardening 

Potatoes 

Fruit Growing 

Cone rete 
Electrification 

Farm Machinery and Power 
Erosion Control 
Home Beautification 
Farm Plumbing 
Composite 


Professional Education 


Test 


rechnical Agriculture and 
Professional Education 

Professional Education and 
Manipulative Skills 

Technical Agriculture and 
Manipulative Skills 


Decimal points have been omitted 
Significant at 5% level 
,Significant at 1% level 
sSignificant at . 1% level 
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The correlations of the composite combina- 
tions of scores, shown in Table V, are without 
statistical meaning, and therefore the statisti- 
cal significance of them was not computed. 
These composite scores are often cor related 
with themselves which automatically raises the 
level of correlation. Where thereare instances 
of a composite that has a high possible score 
being correlated with itself and a composite that 
has a low possibile score, the resulting correla- 
tion is disproportionately high. An example of 
this can be seen between the composite scores of 
the professional education test and the manipu- 
lative farm skill survey being correlated with 
the manipulative farm skills composite. The 
correlation that results is .994. However, the 
manipulative farm skills score that is being 
correlated with itself has a possible high of 
1065, while the professional education test has 
a possible high score of only 105. The scores 
actually made on these instruments (manipula- 
tive farm skills survey and professional educa- 
tion test) makes this improper balance even 
worse. For example, the mean score made on 
the manipulative farm skills survey was 660 
which is 62 percent of the highest possible 
score, while the mean score of right answers 
made on the professional educational test was 
42 which is 40 percent of the highest poss ible 
score, 


Correlations of Competency Scores and 


Success Rating Scores 


1. Individual Ratings 

The correlations between competency scores 
and individual rating scores are presented in 
Table VI. Inspection of this table reveals that 
there are more statistically significant correla- 
tions between farmer rating scores and compe- 
tency scores and between pupil rating scores 
and competency scores than there are between 
any other individual rating scores and compe- 
tency scores. There is a statistically sign ifi- 
cant correlation at the 5% level between the farm - 
er rating score and the poultry manipulative 
farm skills score. There are statistically sig- 
nificant correlations at the 1% level between the 
farmer rating score and the farm management 
test, between the farmer rating score and the 
poultry test, and between the farmer rating 
score and the composite of technical agriculture 
test scores. 

All correlations between pupil rating scores 
and competency scores are statistically signifi- 
cant at the 5% level. These correlations exist 
between the pupil rating scores and scores made 
on the following tests: farm management, hort- 
iculture, soils, and the composite of technical 
agriculture test scores. 

There is a 5% level of statistical significance 
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between the principal rating scores andthe farm 
management test scores, between the principal 
rating scores and the poultry test scores, 
and between the principal rating scores and 
the composite of technical agriculture test 
scores. 

There is a 5% level of statistical significance 
between the supervisory rating score and the 
farm management test score. The supervisory 
rating score has no other statistically signifi- 
cant correlation. However, it correlates high- 
er with the composite of the manipulative farm 
skills score than does any other individual rat- 
ing score. The farmer rating score correlates 
higher with the composite scores of the tech- 
nical agriculture test and the professional educa- 
tion test than does any other individual rating 
score. 

The composite of the individual rating 
scores have a statistically significant correla- 
tion with a greater number of the competency 
scores than does any of the rating scores tak- 
en individually. Significantly, the compos- 
ite of the individual rating scores correlates at 
the 1% level of statistical significance with 
the composite of technical agriculturetest 
scores. It does not have a statistically signifi- 
cant correlation with either the composite 
manipulative skills score or the professional ed- 
ucation test. 

The correlations between each of the individ- 
ual rating scores and each of the competency 
composite scores are consistently positive. 
Each individual rating score has a statistically 
significant correlation with the farm manage- 
ment test score. 

The correlations between individual rating 
scores and the technical agriculture test scores 
are generally higher than they are between the 
individual rating scores and either the manipula- 
tive farm skills score or the professional educa- 
tion test score. The correlations between the 
individual rating scores and the professional ed- 
ucation test scores are generally higher than 
they are between the individual rating scores 
and the manipulative farm skill scores. Judg - 
ing by ratings, test, and skills usedinthis study, 
the above would indicate that there isacloser 
relationship between the success of a vocational 
agriculture teacher, as measured by individual 
ratings, and his knowledge of basic facts in tech- 
nical agriculture than there is between his suc- 
cess, measured by the same criteria, and his 
knowledge of professional education or his judg- 
ment of his ability to perform manipulative farm 
skills. There seems to be a closer relationship 
between his success, as measured by the above 
criteria, and his knowledge of professional edu- 
cation than there is between his success and his 
judgment of his ability to perform manipulative 
farm skills. 
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2. Combinations of Ratings 

The correlations between competency scores 
and combinations of rating scores are present- 
ed in Table VI. This table reveals that the great 
majority of statistically significant correlations 
are found between the combinations of rating 
scores and the technical agriculture test scores. 
Combinations of rating scores have statistically 
significant correlations with only three of the 
manipulative farm skills enterprise scores. 
Three of the combinations of rating scores have 
statistically significant correlations with the 
professional education test score. 

Five of the combinations of rating scores 
have statistically significant correlations with 
six of the competency score columns. These 
combinations of rating scores are: pupil-farm- 
er, pupil-farmer-supervisory, principal-farm - 
er-supervisory, principal-farmer, andthe com- 
posite of combination rating scores. 

Four of the combinations of rating scores 
have statistically significant correlations with 
five of the competency scores. These combina- 
tions of rating scores are: pupil-principal, pu- 
pil-supervisory, pupil-principal-farmer, and 
pupil-principal-supervisory rating scores. Prin- 
cipal-supervisory and farmer-supervisory rat- 
ing scores have statistically significant correla- 
tions with four of the competency scores. 

The composite of combinations of rating 
scores correlates at the 1% level of statistical 
significance with the composite of technical ag- 
riculture test scores, and it correlates at the 
5% level of statistical significance with the pro- 
fessional education test scores. The correla- 
tion between the composite of combinations of 
rating scores and the composite score of ma- 
nipulative farm skills is positive but not statis- 
tically significant. 


The Prediction of Success 





Table VII presents correlations used in re- 
jecting or accepting the first three null hypoth- 
eses postulated in this study. The correlations 
between the composite of technical agriculture 
test scores and the composite of individual rat- 
ing scores, and between the composite of tec h- 
nical agriculture test scores and the composite 
of combinations of rating scores are statistical- 
ly significant at the 1% level. This means that 
there is a statistically significant relationship 
between the technical agriculture test scores 
and the success of vocational agriculture teach- 
ers, success being measured by composite of 
rating scores. On the basis of these correl- 
ations being statistically significant from zero, 
the first null hypothesis postulated in this study 
was rejected. 

Having established that there is a statistical- 
ly significant relationship between a vocational 
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agriculture teacher’s competency in tec hnical 
agriculture and his success as a teacher of vo- 
cational agriculture, it was decided to determine 
the predictive value of the coefficient of correla- 
tion. This was done in part by computing the 
standard error of estimate. (See Table VII.) 
The formula (12,47) used in this computation 
was Sy= oyV1i - r2, where oy = standard devi- 
ation of the predicted scores (composite of indi- 
vidual rating scores), and r = the coefficient of 
correlation between the two variables. Subs ti- 
tuting into the formula give Sy = 4. 64V1-(.387)?. 
The standard error of estimate was found to be 
3.94 for the correlation between the composite 
of technical agriculture test scores and the com- 
posite of individual rating scores. Substituting 
into the above formula for the correlation be- 
tween the composite of technical agriculture test 
scores and the combination of composites of rat- 
ing scores, we get Sy = 9.57V1 -(. 362)”, which 
equals 8.32. So, the error that might be expect- 
ed in predicting individual scores where r= .362 
is more than twice as great as the error that 
might be expected in predicting individual scores 
where r = . 387. 

More specifically, the ratio of the residual 
variance | or the value 1 - r(12,47)] to the total 
variance is found to be .85 for r = .387 and . 87 
for r = .362. (See Table VII.) This means that 
only 15 percent of the total variance of scores is 
accounted for by the first coefficient of cor re - 
lation, and 13 percent of the total variance of 
scores is accounted for by the second coefficient 
of correlation. Thus, while both coefficients of 
correlation may have some predictive value for 
groups of vocational agriculture teachers, they 
have very limited value for predicting individual 
scores. 

As may be seen in Table VII, the correlations 
between the composite of manipulative farm 
skill scores and the composite of individual rat- 
ing scores, and between the composite of manip- 
ulative farm skill scores and the composite of 
combinations of rating scores are not statistical- 
ly significant. This means that there is no sta- 
tistically significant relationship between the 
manipulative farm skill scores and the succ ess 
of vocational agriculture teachers, success be- 
ing measured by composites of rating scores. 
On the basis of these correlations being statis- 
tically insignificant from zero, the second nul] 
hypothesis postulated in this study was accepted 

Using the same reasoning, methods, and pro- 
cedures as those above, the standard error of 
estimate and the ratio of residual variance to 
the total variance were calculated for r = .131 
and r= .146. Results of these calculations ap- 
pear in Table VII. Neither correlation has any 
value for predicting group scores nor for pre- 
dicting individual scores. 

Again referring to Table VII, it may be seen 
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TABLE VI 


THE CORRELATIONS OF CRITERIA RATING SCORES WITH AGE, YEARS OF TEACHING EXPERIENCE, 
TECHNICAL AGRICULTURE TEST SCORES, MANIPULATIVE FARM SKILL SCORES, PROFESSION - 
AL EDUCATION TEST SCORES, AND COMBINATIONS 
OF COMPOSITES OF COMPETENCY 





~ Technical Agriculture Test Scores "Manipulative Farm Skill Scores 


Experience Teaching 
Dairy Cattle Test 
Farm Management 
nical Agriculture 
Dairy and Beef Cattle 


Test Scores 


Horticulture Test 
Composite of Tech-- 


Poultry Test 
Soils Test 
Swine Test 


Individual Raters 





Pupil 

Principal 

Farmer 

Supervisory 

Composite of Individual 
Raters 


Combinations of Raters 


Pupil-Principal 

Pupil- Farmer 

Fupil-Supervisory 

Pupil-Principal- Farmer 

Pupil-Principal-Super- 
visory 

Pupil- Farmer -Supervisory 

Principal- Farmer 

Principal -Supervisory 

Principal- Farmer -Super - 
visory 

Farmer -Supervisory 

Composite of Combinations 
of Raters 053 


Decimal points have been omitted. 


, Significant at the 5% level 
, Significant at the 1% level. 
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Manipulative Farm Skill Scores Combinations of Composites 
of Scores 





Technical Agricultural 
and Professional 


Education 
Technical Agricultural 


and Manipulative Farm 
and Manipulative Farm 


Skills 


Meadow and Pasture 
Gardening 

Fotatoes 

Fruit Growing 
Concrete 
Electrification 

and Power 

Erosion Control 
Home Beautification 
Farm Plumbing 
Composite of Manip- 
ulative Farm Skill 
Scores 

Professional Educa- 
tion Test 
Professional Education 
Total Composite 

of Competencies 





| Farm Machinery 


| 
| 
| 


— 
~ 
= 
Se 


046 
098 157 
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TABLE VI 


THE CORRELATIONS OF COMPETENCY VARIABLES WITH SUCCESS CRITERIA, THEIR STANDARD 
ERROR OF ESTIMATE, AND RESIDUAL VARIANCE 








Composite of Techni- Composite of Manipu- 
cal Agriculture Test lative Farm Skill Sur- | Professional Education 
Scores vey Scores Test Scores 





r Sy R-V Sy R-V 





Composite of individ- 
ual rating scores . 387, , ; , . . 98 ; 4. 38 . 94 

Combination of com- 
posites of rating 
scores 











, Residual Variance 
,Significant at 1% level. 
, Significant at 5% level. 


TABLE VIII 


CORRELATION MATRIX FOR SOLVING REGRESSION EQUATION NUMBER ONE 





Xo X3 X4 





.131 








TABLE Ix 


CORRELATION MATRIX FOR SOLVING REGRESSION EQUATION NUMBER TWO 





X3 X4 


. 146 
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that the correlation between the professional ed- 
ucation test and the composite of individual rat- 
ing scores is not statistically significant. In 
order to be statistically significant at the 5% 
level, this correlation would have to beat least 
.258. The correlation of . 264 between the pro- 
fessional education test and the combination of 
composites of rating scores, however, is sta - 
tistically significant at the 5% level. This indi- 
cates that there is no statistically significant 
relationship between the professional education 
test score and the success of vocational agricul - 
ture teachers when success is measured by a 
composite of individual ratings. It also indi- 
cates, however, that there is a statistically sig- 
nificant relationship between the professional 
education test score and the success of voca- 
tional agriculture teachers when success is 
measured by a composite of combinations of rat- 
ing scores. On the basis of this finding, the 
third null hypothesis postulated in this study is 
neither accepted nor rejected. It is left open 
for question and further study. 

The high percentage of residual variance 
found for both correlations is interpreted to 
nu ean that neither correlation has much value 
in predicting individual scores. 

It was decided that in order to check the 

fourth null hypothesis postulated in Section I, 
two regression equations would be calculated. 
In the first regression equation the technical ag- 
riculture test composite score, the mani pula- 
tive farm skills survey score, and the profes- 
sional education test score were used topredict 
the composite of individual rating scores. Inthe 
second the same competency scores listed above 
were used to predict the composite combinations 
ot rating scores. 

For solving the first equation mentioned 
above, the iollowing symbols were assigned to 
the variables: X,, composite of individual rat- 
ings; X,, composite of technical agriculture 
test scores; X,, composite of manipulative 
farm skills survey scores; and X,, profession- 
al education test scores. Then their intercor- 
relations were calculated and placed in a cor - 
relation matrix. (See Table VIII.) This matrix 
was then solved, using Aitkin Modified Method 
of Pivotal Condensation (44,12). Using the mul- 
tiple correlation formula (12), R, 234 = VBP 2+ 
B;r,; + Byr,, the beta coefficients were found 
to be R,.23, = V(. 361)(. 387) + (.173)(.131) + 
(. 091)(. The regression equation for all 
four variables yields a multiple correlation of 
429. 

By using the formula t = rvf _ and the 

v1-R? 
t table in Statistical Methods in Research by 
Johnson (24), the multiple correlation of .429 was 
found to be statistically significant at the 1% lev- 
el. This means that there is a statistically sig- 
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nificant relationship between the combination of 
competencies and success of vocational agricul- 
ture teachers, success being measured byacom- 
posite of individual rating scores. On the basis 
of this correlation being statistically significant 
from zero, the fourth null hypothesis postulated 
in this study was rejected, pending the findings 
of the second regression equation yet to be cal- 
culated. 

After concluding that the competencies have 
some relationship to success as measured by the 
composite of individual rating scores, the next 
step was to determine the predictive value of the 
prediction equation. The formula Sy =oyv 1 - R? 
was used to caiculate the standard error of esti- 
mate. Substituting into the formula gives 
Sy = 4.64V1 - (.429)", which equals 4.19. An 
example of the use of this standard error of esti- 
mate score is given by taking one actual predict- 
ed score of 52.42. Using this actual predicted 
score of 52.42, one can predict that 95.45*times 
out of 100 the true score would be expected to 
fall between 44. 04 and 60. 80. 

The ratio of the residual variance to the total 
variance for this prediction equation is .82. This 
means that only 18 percent of the total variance 
of scores is accounted for by this particular re- 
gression equation. So, while the regression 
equation may have some predictive value fo: 
groups of vocational agriculture teachers, ithas 
limited value for predicting individual scores. 

In order to check the reliability of the compos- 
ite of the technical agriculture test score, com - 
posite of manipulative farm skill survey score, 
and the professional education test score to pre- 
dict vocational agriculture teacher’s success as 
measured by the composite of combinations of 
rating scores, a second regression equation 
was calculated. The following symbols were as- 
signed to the variables that were used in this 
equation: X,, composite of combinations of rat 
ing scores; X,, composite of technical agricul 
ture test scores; X,, composite of manipulative 
farm skills survey scores; and X,, professional 
education test scores. The matrix formed by the 
intercorrelation of these variables is presented 
in Table IX. 

Using the same methods and procedure as 
those used in the first equation, it was found that 
the four variables used in this regression equa- 
tion yields a multiple correlation of .423. This 
correlation is statistically significant at the 1% 
level. Therefore, there is a statistically signif- 
icant relationship between the combination of 
competencies used in the regression equation, 
and the success of vocational agriculture teach- 
ers, success being measured by a composite of 
combinations of rating scores. Since this cor- 
relation is statistically significant from zero, 
it supports the finding of the first regresion 
equation and the fourth null hypothesis postu- 
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lated in this study was rejected. 

The standard error of estimate for the sec- 
ond regression equation is 8.67. The ratio of 
the residual variance to the total variance is .82, 
which is the same ratio as that found for the 
first equation. The conclusion is drawn that 
while this regression equation may have some 
predictive value for groups of vocational ag ri- 
culture teachers, it might be consideredas hav- 
ing limited value for predicting individual scores. 

In the first analysis of the data, the correla- 
tions of various enterprises under the technical 
agriculture tests and of various enterprises un- 
der the manipulative farm skills survey seemed 
to be sufficiently high to warrant further study 
in search of more reliable regression equa- 
tions for predictive purposes. It was then de- 
cided to calculate four additional regression 
equations using the same methods and proced- 
ures as previously reported. These additional 
regression equations will make the third, fourth, 
fifth, and sixth regression equations used inthis 
study. 

The third regression equation involved the 
use of variables X,, the farm management test 
score; X,, the dairy and beef cattle manipula - 
tive farm skills score; and X,, the profession- 
al education test score to predict X,, the com- 
posite of individual rating scores. The matrix 
formed by the intercorrelation of these vari - 
ables is presented in Table X. The regression 
equation for these four variables yields a multi- 
ple correlation of .508. This correlation is high- 
er than either of the previous multiple cor rela- 
tions. It is statistically significant at the .1% 
level. The standard error of estimate for this 
equation is 4.00. This standard error of esti- 
mate is smaller than the standard error of esti- 
mate for either of the above two equations, in- 
dicating that the range within which one might 
expect a predicted score to fall is not as great 
as the range within which one might expect a 
predicted score to fall for the first and second 
regression equations used in this study. 

The ratio of the residual variance to the to- 
tal variance is .74. This means that 26percent 
of the total variance of scores is accounted for 
by this particular regression equation. So, 
while this regression equation has more value 
in predicting individual scores than either of the 
above equations, it still does not account for 
enough of the total variance to be of great value 
for that purpose. 

The fourth regression equation involved the 
use of variables X,, the farm management test 
score; X,, the dairy and beef cattle manip ula- 
tive farm skills score; and X,, the professional] 
education test score to predict X,, the compos- 
ite of combinations of rating scores. The ma- 
trix formed by the intercorrelation of these var- 
iables is presented in Table XI. The multiple 
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correlation of this regression equation is .492. 
This multiple correlation is statistically signifi- 
cant at the .1% level. The standard error of es- 
timate for this equation is 8.34, and the ratio 
of the residual variance to the total variance is 
.76. As was true with the previous regression 
equations, this one has no great value for pre- 
dicting individual scores. 

The fifth regression equation involved the 
scores made 0. two of the technical agriculture 
test enterprises, two of the manipulative farm 
skill survey enterprises, the professional educa- 
tional test, and the composite of individual ra t- 
ing scores. The variables and the symbols as- 
signed to them are: X,, the farm management 
test score; X,, the poultry test score; X,., the 
dairy and beef cattle manipulative farm skills 
score; X,, the poultry manipulative farm skills 
score; Xs, the professional education test score; 
and X,, the composite of individual rating 
scores. Variables X, through X, were em- 
ployed to predict X,. The matrix formedby the 
intercorrelation of these variables is presented 
in Table XII. The multiple correlation for this 
regression equation is .486, making it statisti- 
cally significant at the .1% level. The standard 
error of estimate is 4.06 and the ratio of the res- 
idual variance to the total variance is .76. This 
is the same ratio as was found in the preceding 
equation, so the same conclusion can be drawn 
from it. It should be noted that by adding the two 
factors to the variables used in regression equa- 
tion number three the multiple correlation is low- 
ered and not raised. 

The sixth and last regression equation calcu- 
lated involved the use of variables X,, the farm 
management test score; X,, the poultry test 
score; X,, the dairy and beef cattle manipula- 
tive farm skills score; X,, the meadow and pas- 
ture manipulative farm skills score; and X,, the 
professional education test score to predict X,, 
the composite of combinations of rating scores. 
The matrix formed by the intercorrelations of 
these variables is presented in Table XIII. This 
regression equation has a multiple correlation 
of .468, which is statistically significant at the 
.1% level. The standard error of estimate is 
8.46 and the ratio of the residual variance to the 
total variance is .78. This means that only 22 
percent of the total variance of scores is account- 
ed for by this regression equation and therefore, 
it has no great value in predicting individual 
scores. It is worthy of note that by adding the 
two factors to the variables used in regression 
equation number four the multiple correlation is 
lowered. 

Table XIV presents the multiple correlations, 
levels of statistical significance, standarderror 
of estimates, and residual variances for the six 
regression equations calculated in this study. In 
comparing Table XIV with Table VII, it is noted 
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TABLE X 


CORRELATION MATRIX FOR SOLVING REGRESSION EQUATION NUMBER THREE 





xX X3 X4 





. 256 . 236 
- .O11 466 
1. 000 - .179 


- .179 1. 000 





TABLE XI 


CORRELATION MATRIX FOR SOLVING REGRESSION EQUATION NUMBER FOUR 





Xj X9 X3 X4 





. 250 . 264 


- .O11 . 466 
1. 000 - .179 


- .179 1.000 





TABLE XII 


CORRELATION MATRIX FOR SOLVING REGRESSION EQUATION NUMBER FIVE 





xy XQ X3 a, | X6 
425 331 241 
264 119 
000 052 344 
010 633 179 
052 ‘ . 000 - ,062 


. 062 000 
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TABLE XIll 


CORRELATION MATRIX FOR SOLVING REGRESSION EQUATION NUMBER SIX 





Xy . X Xs X¢ 


1.000 





. 397 


. 343 


. 250 


. 234 


. 264 





TABLE XIV 


MULTIPLE CORRELATIONS, LEVELS OF SIGNIFICANCE, STANDARD ERROR OF 
ESTIMATES, AND RESIDUAL VARIANCES FOR SIX REGRESSION EQUATIONS 


ee 





Regression Multiple Levels of Standard Error Residual 
Equation* Correlations Significance of Estimates Variance 





1 . 429 1% 4.19 . 82 
2 . 423 1% > . 82 


. 508 ‘ . . 74 


. 492 ‘ : . 76 


5 . 486 1% . . 76 


6 . 468 . , . 78 





*Regression equations are listed in the same order that they are presented in this section. 
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that all multiple correlations are higher than 
the simple correlations. Also, the residual 
variances of the regression equations are low- 
er than the residual variances of the simple cor- 
relations, indicating that the multiple correla- 
tions are better predictors of vocational agricul - 
ture teacher success than are the sample cor- 
relations. 

All multiple correlations are statistically 
significant, indicating that the relationships 
found cannot be attributed to chance alone. Re- 
gression equation number 3 appears to be the 
best predictor of vocational agriculture teacher 
success investigated in this study. In the third 
regression equation, the farm management test 
score, the dairy and beef cattle manipulative 
farm skills score, and the professional educa- 
tion test score were employed to predict the suc - 
cess of a vocational agriculture teacher, the cri- 
terion of success being the composite of individ- 
ual rating scores. 


SECTION IV 
SUMMARY AND CONCLUSIONS 


Statement of the Problem 





THE PURPOSE of this investigation was to 
study the relationship between the success at- 
tained by vocational agriculture teachers and 
certain competencies that these vocational agri- 
culture teachers possess. 


Design of the Study 





The subjects of this investigation were a ran- 
dom sample of sixty vocational agriculture 
teachers who teach in one teacher vocational 
agriculture departments of public high schools 
located in approximately the southern two-thirds 
of the state of Wisconsin. 

The measure of teacher success was deter- 
mined by ratings given to each vocational ag r i- 
culture teacher by: (1) state supervisors of vo- 
cational agriculture, (2) high school principals, 
(3) high school pupils taught by the teacher, and 
(4) farmers in the local school community. A 
composite score of individual raters and a com- 
posite score of combinations of raters were 
used in analyzing the data. 

The competencies of vocational agriculture 
teachers that were measured in this investiga- 
tion were in the. areas of technical agriculture, 
manipulative farm skills, and professional ed- 
ucation. Technical agriculture competency 
was measured by administering tests ol tactual 
information in seven technical agricultural 
fields. These tests were in the areas of agron- 
omy, dairy cattle, farm management, horticul- 
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culture, poultry, soils, and swine. 

Competency in manipulative farm skills was 
measured by a self-rating survey of manip ula- 
tive farm skills that was completed by each sub- 
ject. This survey of skills was limited to fif- 
teen farm enterprises or areas as follows: dairy 
and beef cattle, poultry, swine, corn, meadows 
and pastures, small grain, gardening, potatoes, 
fruit growing, concrete, electrification, farm 
machinery and power, erosion control, home 
beautification, and farm plumbing. 

The measure of professional education com- 
petency of vocational agriculture teachers was 
accomplished by administering the professional 
information section of the 1951 edition of the Na- 
tional Teacher Examination to each teacher par- 
ticipating in this investigation. 

Using the two composites of scores for the 
criteria and the raw scores from the measures 
of competence, Pearson product-moment corre- 
lations and regression equations were calculat- 
ed to determine the relationship between voc a- 
tional agriculture teacher success and c er tain 
competencies possessed by these teachers. 


Summary of Findings 


All tests in technical agriculture were de- 
signed and developed in a similar manner. They 
all dealt with basic and fundamental! factual ma- 
terial in their respective areas. Because of 
these similarities, the various tests of technical 
agriculture were assumed to have approximate- 
ly equal difficulty and equal basic understanding 
requirements. 

Percentage scores made on the tests in tech- 
nical agriculture indicate that vocational agri- 
culture teachers in Wisconsin, from which this 
sample was chosen, have a better knowledge of 
basic facts in animal enterprises than they have 
in other farming enterprises investigated in this 
study. These teachers appear to have less knowl- 
edge of basic facts in soils and farm manage- 
ment than they have in other areas of farm en- 
deavor investigated in this study. Their knowl- 
edge of basic facts in agronomy and horticulture 
seems not as great as their knowledge of basic 
facts in animal enterprises. However, their 
knowledge of basic facts in agronomy and horti- 
culture seems greater than their knowledge of 
basic facts in soils and farm management. 

The mean score made by the vocational agri 
culture teachers on the professional education 
test was about thirteen points lower than the 
mean score made by persons who expressed a 
preference for teaching vocational subjects who 
took the nation-wide administration of the same 
test in 1951. This comparison must be made 
with caution since the number of vocational 
teachers used in this study is small compared 
with the number of persons expressing voca - 
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tional teaching preferences who took the nation- 
al administration of the test in 1951. Also, per- 
sons taking the national administration of the 
test in 1951 may have made special study and 
reviews in preparation for taking the test be- 
cause of its use in teacher evaluation and pro- 
motion in some situations. No such special 
preparation was made by teachers participating 
in this study. 

There was no particular relationship among 
the mean, high, and low percentage scores 
made on the various enterprises of the manipu- 
lative farm skills survey. This indicates a 
rather wide diversity of individual competencies 
in performing agricultural skills. 

There were consistently low correlations be- 
tween the manipulative farm skills scores and 
the technical agricultural test scores. These 
consistently low correlations indicate that there 
is very little relationship between a vocationa] 
agriculture teacher’s knowledge of factual infor - 
mation in agriculture and his own judgment of 
his ability to perform manipulative farm skills. 

All correlations between the professional ed- 
ucation test scores and scores made on various 
enterprises of the technical agriculture test 
were positive, and a majority of them were sta- 
tistically significant. There was a statistically 
significant correlation between the professional 
education test score and the technical agricul- 
ture test composite score. These correlations 
indicate that there is a significant relationship 
between a vocational agriculture teacher’s in- 
formation on professional education and his 
knowledge of basic facts in technical agricul- 
ture enterprises. 

All correlations between professional educa- 
tion test scores and manipulative farm skill 
scores were negative except one, andnone were 
statistically significant except one, which indi- 
cates that there is very little relationship be- 
tween a vocational agriculture teacher’s infor- 
mation on professional education and his own 
judgment of his ability to perform manipulative 
farm skills. 

In order to facilitate the achievement of the 
purpose of this study, four null hypotheses 
were formulated. These hypotheses served as 
a guide in making basic judgments that were nec - 
essary in this study. The four null hypotheses 
tested in this study were: 


1. There is no statistically significant relation- 
ship, as shown by coefficients of correlation, 
between a vocational agriculture teacher’s 
knowledge of technical agricultural informa- 
tion and his success as a teacher. 


. There is no statistically significant relation- 
ship, as shown by coefficients of correlation, 
between a vocational agriculture teacher s 
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proficiency in performing agricultural man- 
ipulative skills and his success asa teacher. 


. There is no statistically significant relation- 
ship, as shown by coefficients of correlation, 
between a vocational agriculture teacher's 
knowledge of professional educational infor- 
mation and his success as a teacher. 


. There is no statistically significant relation- 
ship, as shown by regression equations, be- 
tween a vocational agriculture teacher's 
knowledge of technical agricultural informa- 
tion, proficiency in performing agricultural 
manipulative skills, and knowledge of pro- 
fessional educational information and his 
success as a teacher. 


The first null hypothesis postulated above 
was rejected. It was rejected on the basis of 
statistically significant correlations between the 
composite of technical agriculture test scores 
and the composite of individual rating scores, 
and between the composite of technical agr icul- 
ture test scores and the composite of combina- 
tions of rating scores. 

The second null hypothesis postulated in this 
study was accepted. It was accepted because 
there was no statistically significant correlation 
between the composite of manipulative farm 
skill survey scores and the composite of individ- 
ual rating scores, and between the composites 
of manipulative farm skill survey scores and 
the composite of combinations of rating scores. 

The third null hypothesis postulated in this 
study was neither accepted nor rejected. It was 
left open for question and further study. This 
decision was made on the basis of a statistical- 
ly insignificant correlation being found between 
the professional education test score and the 
composite of individual rating scores, while a 
statistically significant correlation existed be- 
tween the professional education test score and 
the composite of combinations of rating scores. 

The fourth null hypothesis postulated in this 
Study was rejected. It was rejected on the bas- 
is of statistically significant correlations be- 
tween the combination of competency scores and 
the composite of individual rating scores, and 
between the combination of competency scores 
and the composite of combinations of rating 
scores. 

No coefficients of correlation and no regres- 
sion equations investigated in this study account- 
ed for enough of the total variance of scores to 
make them entirely satisfactory for predicting 
individual scores. 

The best predictor of vocational agriculture 
teacher success found in this study was using 
the combination farm management test score, 
dairy and beef cattle manipulative farm skills 





September 1956) 


score, and the professional education test score 
to predict the composite of individual rating 
scores. The technical agriculture tests were 
better predictors of vocational agriculture 
teacher success than were the manipulative 
farm skills, which had very little relationship 
to success, or the professional education test, 
whose exact relationship to vocational agricul- 
ture teacher success was not determined. The 
best single predictor of vocational agriculture 
teacher success was the farm management test. 


Conclusions 


The relatively low percentage scores made 
on the farm management and soils technical ag- 
riculture tests, the professional education test, 
and several of the manipulative farm skill enter- 
prises leads one to question the adequacy of the 
curriculum of training of vocational agriculture 
teachers in these areas. 

A vocational agriculture teacher needs acom- 
prehensive knowledge of farm management and 
soils if he is to give maximum service to farm- 
ers. The farm management test correlates 
higher with success rating composites than any 
othér single competency measure. This indi- 
cates that there is a closer relationship between 
a vocational agriculture teacher’s success, as 
measured by composites of ratings, and his 
knowledge of basic information in farm manage- 
ment than there is between his success, as 
measured by the same criteria, and knowledge 
of basic information in any other technical agri- 
cultural enterprise investigated in this study. 

The correlations between both soils test and 
the professional education test with success as 
measured by composite of ratings is statistical- 
ly significant. 

Findings in this investigation tend to substan- 
tiate findings by Rhoad (study referred to inSec- 
tion II), concerning the ability of vocational ag- 
riculture teachers to perform manipulative 
farm skills. It cannot be assumed that voca - 
tional agriculture teachers adequately learn to 
perform manipulative farm skills on the home 
farms. All teachers participating inthis study 
were farm reared except one, and yet, they do 
not judge themselves as being very proficient 
in performing manipulative farm skills. In view 
of this finding, it would appear wise for training 
institutions to devote more time to the training 
of vocational agriculture teachers and prospec - 
tive teachers to perform manipulative farm 
skills more efficiently. 


Implications for Further Study 





As a result of findings in this investigation, 
the author wishes to make five recommenda - 
tions for further study along the line of predict- 
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ing vocational agriculture teacher success. 

The first recommendation is that the farm 
management test, the poultry test, the soils test, 
and the swine test that were used in this investi- 
gation be given further study with a view toward 
making them, if possible, better individual and 
collective predictors of vocational agriculture 
teacher success. These tests of technical agri- 
culture showed statistically significant relation- 
ships with vocational agriculture teacher suc- 
cess as measured by composites of raters. 
Through an item analysis one could determine 
which questions in these tests best differentiate 
the most successful teachers from the less suc- 
cessful teachers. In this manner one might de- 
velop an instrument that would better predict vo- 
cational agriculture teacher success. 

The second recommendation is that the pro- 
fessional educational test used in this investiga- 
tion be given further study with a view toward 
making it a valuable predictor of vocational agri- 
culture teacher success. The value of the pro- 
fessional education test as a predictor of voca- 
tional agriculture teacher success was inconclu- 
sive in this investigation. As previously stated, 
the subjects used in this investigation made rel- 
atively low scores on the professional education 
test. It might be that vocational agriculture 
teachers are so laden with keeping conversant 
with technical information that they are forced 
to give professional information minimum at- 
tention. Then too they may depend more on prac - 
tical, seemingly logical solutions than upon 
knowing established principles. An item analy- 
sis of the professional education test should indi - 
cate the type of professional questions that agri 
culture teachers answer correctly and whichare 
the most discriminating questions. Such knowl- 
edge might aid in the development of an instru- 
ment in professional education that would be par 
ticularly suited for predicting vocational agri 
culture teacher success. 

The third recommendation is that additiona |] 
objective data such as age, teaching experience, 
college grade point average, credits in technical 
agriculture received in college, credits in pro 
fessional education courses received in college, 
credits in general education courses received in 
college, and practice teaching credits be em 
ployed in a study such as this to predict voca- 
tional agriculture teacher success. If cer tain 
objective data suggested here were used in con- 
junction with the most predictive variables of vo 
cational agriculture teacher success used in this 
study, improved prediction of vocational ag r i- 
culture teacher success might be possible 

The fourth recommendation is that certain 
subjective data in the areas of human rela tion- 
ships and personality be employed in a statisti- 
cal way to determine their importance as pre 
dictors of vocational agriculture teacher s u< 
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cess. The somewhat unique responsibilities 
and duties that a vocational agriculture teach- 
er has in a school and in his community might 
make his personal qualities very important to 
his success as a teacher. The use of such sub- 
jective data in conjunction with certain objec- 
tive data might prove to be of great value for 
predicting vocational agriculture teacher suc- 
cess. 

Finally, the author recommends further 
study of subjective ratings, andthe possible use 
of residual pupil gains as success criteria in 
studies of vocational agriculture teacher suc- 
cess. The criterion by which teaching success 
is evaluated is of great importance. An objec- 
tive criterion such as residual pupil gains might 
add much to studies of this kind. The fact that 
only one school subject, vocational agriculture, 
is being dealt with, and that the teachers being 
investigated have the same curriculum for use 
as a guide in teaching would facilitate the use 
of residual pupil gains as a criterion of voca- 
tional agriculture teacher success. It appears 
that composites of ratings give better results 
than ratings used singly. However, more study 
is needed in defining aspects of teaching to be 
evaluated and in objectifying subjective rating. 
as much as possible. It is believed that the 
use of these recommendations will lead to better 
studies of the prediction of vocational agric ul- 
ture teacher success. 
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THE ROLE OF EVALUATION IN THE IM- 
PROVEMENT OF INSTRUCTION IN INSTI- 
TUTIONS OF HIGHER LEARNING 


JAMES E. GREENE, Sr. 
University of Georgia 


IN APPROACHING the present task of dis - 
cussing the role of evaluation in the improve - 
ment of instruction, an attempt will be made to 
provide brief, tentative, and perhaps somewhat 
personalized answers to the following questions: 


1. What is the essential rationale of a philosophy 
of evaluation of instruction? 


. What evidences can be cited to indicate that 
emphasis upon improved evaluations of in- 
struction tend to improve the general quality 
of instruction? 


. How can an institution of higher learning im- 
prove its program of evaluation of instruc - 
tion? 


For our present purposes, the term evalua- 
tion will be used as referring to (1) a process, 
and (2) a product. Considered as a process, e- 
valuation refers to the procedures by means of 
which value judgments are made concerning a 
condition or procedure having implications for 
effective instruction. Considered as a product, 
evaluation refers to the nature and characteris- 
tics of the value judgments themselves. 


The Rationale of a Philosophy of the Evaluation 
of Instruction 








If emphasis is to be placed on the rationale of 
evaluation in the improvement of instruction, 
the first logical step involved inthe development 
of our theme would consist of a logical analysis 
of the basic constituent elements involved in ef- 
fective instruction. For our present purposes 
it is held that instruction is likely to be effec- 
tive in proportion as: 


1. Each objective of instruction is clearly under - 
stood and fully accepted by the learner andis 
uniquely appropriate to his abilities and needs. 


. Each of the learning situations comprising 
the instructional program (i.e., teacher and 
learner activities, methods and materials of 





instruction, climate of learning, etc., ) is nice- 
ly adapted to the efficient attainment of one or 
more of the objectives sought. 


. Teacher and learner each secure, analyze and 
interpret evidences concerning the total effic- 
iency of the instructional process. 


The overall task of evaluation in relation to 
the improvement of instruction would appear thus 
to consist of finding sound and defensible an- 
swers to such questions as the following: 


1. To what extent has each learner made or 
failed to make satisfactory progress toward 
the attainment of each of the objectives of in- 
struction originally formulated and accepted 
by both teacher and learner? 


2. To what extent were the original objectives of 
instruction appropriate or inappropriate to 
each learner? 


. What revisions, if any, of the objectives of in- 
struction would appear to be desirable? 


. To what extent were the instructional proced 
ures (i.e., materials, methods, etc.,) appro 
priate to the attainment of the specific objec 
tives sought? 


. What revisions, if any, of the instructional 
procedures appear to be desirable? 


If evaluation is to serve the purposes thus far 
stated or implied, it is requisite that evaluations 
conform to certain basic principles and that cer- 
tain basic procedures in evaluation are rigorous- 
ly observed. 


What basic principles are involved in the evalua- 
tion of instruction? 


Conformity to the following principles is held 
to be basic to the development of a sound pro- 
gram of evaluation: 

Evaluations of instruction must have a defin- 


*This article and the succeeding three articles (including an article each by Drs. Ralph Berdie and 
William Coleman, which have been published elsewhere) were presented before the symposium jointly 
sponsored by the AERA and Section Q of the AAAS in Atlanta, Georgia, December 27, 1955. 
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ite frame of reference. That is, evaluations 
are to be made in terms of the specific values, 
goals or objectives of teacher and learner if 

» ich evaluations are to be meaningful and help- 
ful. Evaluative procedures which fail to take 
into account the self-determined goals of the in- 
dividual being evaluated are not only of limit- 
ed or doubtful worth; they may actually be per- 
nicious in their distorting or coercive effects. 

Evaluations should be continuous and c um u- 
lative. Any evaluation as of a given moment 
is likely to be erroneous or incomplete in cer- 
tain particulars; and, in any case, evaluations 
as of a given moment cannot show changes in 
status. Furthermore, since the goals of indi- 
viduals change as conditions change, it is nec- 
essary for sound evaluative procedures to take 
into account these changes in individual goals 
for the reason that the prognostic significance 
of a given evidence of excellence may vary 
from time to time in such a way as to make that 
evidence of greatly unequal value on different 
occasions. 

Evaluations should be comprehensive and 
conclusive. Since in any given situation m u lti- 
ple goals of learning usually are being sought 
it is necessary to secure evidences of the extent 
to which each of the goals of instruction has 
been or is being attained. It is clear that in 
certain instances given goals may be mutually 
exclusive, or that progress toward a given goal 
may be offset by losses with respect to other 
goals. While individuals should be evaluated on 
the basis of a ‘‘total pattern’’ of characteristics 
of desired excellence, it should be recognized 
that superiority in some characteristic may be 
regarded as compensating, to some extent, for 
deficiencies in other respects. 

The primary purpose of all evaluative pro- 
cedures is that of encouraging and promoting 
improvement with respect to the condition or 
activity being evaluated. Consequently, all e- 
valuative procedures should permit of and pro- 
vide for specific, constructive suggestions for 
improvement. In general, effective evaluation 
will make slight and incidental, if any, use of 
inter-individual comparisons; rather it will 
compare the record of the given individual at 
successive time intervals and always inthe 
light of his own unique needs and purposes. Eval- 
uative procedures should generally avoid the 
use of the concept of ‘‘fixed standards’’ of learn- 
er attainment—since in the past this concept has 
often implied ‘‘an identity of individual learner 
needs and purposes.’’ Sound evaluative proced- 
ures will emphasize flexibility and optimum 
growth in terms of differential purposes. 

In view of the essential nature of evaluation 
(i.e., making value judgments of the progress be- 
ing made toward specific objectives) andof the 
basic purpose of evaluation (i.e., improvement 
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of a condition or a process) it is clear that sound 
evaluative procedures will involve the active 
participation of the persons primarily concerned 
in the evaluation. That is, effective evaluation 
will emphasize self-appraisal activities. How- 
ever, this statement does not exclude the use of 
outside persons of specialized skills in evalua- 
tion who, on invitation, may be prepared to 
serve in a resource or consultant capacity on 
various technical aspects of the evaluation pro- 
gram. Such consultants would likely be of most 
value in: 


1. suggesting clarifications or sub-analyses of 
objectives such that it would be possible to se- 
cure appropriate evidences relative to each 
sub-objective; 


. Suggesting possible techniques and procedures 
for securing appropriate evidences of goal 
attainment; 


. Suggesting cautions to be observed in relat- 
ing the obtained evidences to the objectives 
sought. 


What basic procedures are involved in the 
evaluation of instruction? 


Evaluation of instruction involves the follow- 
ing fundamental processes: 


Adequate Analysis of Objectives— That is, ob- 
jectives must be analyzed in such terms that it 
is possible to secure appropriate evidences of 
the extent to which such objectives are being 
realized. It is fruitless to formulate an objec- 
tive, however worthy, unless it is possible toan- 
alyze it in such a way that evidences can be ob- 
tained to show the extent to which it is being re- 
alized. If the objectives of instruction are stat- 
ed in vague or general terms it may be difficult 
to secure evidences showing the extent to which 
they have been attained. 

Securing Appropriate Evidences of a Status 
Product, or Process—All evidence items must 
have a clear and definite (even if indirect) rela- 
tionship to the objectives. Evidences may in- 
volve either subjective or objective data, or both. 
Commonly used forms of evidence include: 
scores on objective or essay tests, products cre- 
ated by the learner, rating scales, interviews, 
anecdotes, sociometric devices, observational 
data, etc. It is clear that the type of evidence 
required in a given situation will be intimately 
related to the specific objective, i.e., the na- 
ture of the objective will determine the type of 
evidence required by the situation. Obviously, 
the evaluation will be sound only in proportion 
to the quantity and quality of the evidence upon 
which it is based. 
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Relating the Obtained Evidences to the Objec - 
tives Sought—This step involves critical, reflec- 
tive thinking in answering the query, ‘‘To what 
extent do the available evidences indicate that 
the desired objectives have been or are being ef- 
fectively realized?’’ It is again obvious that the 
evaluations obtained will be dependent upon the 
soundness of the analytic procedures employed 
in arriving at them. 





Empirical Justification of an Emphasis on Im 
proved Evaluations of Instruction 








The empirical data to be here cited will be 
limited to a single institution. As basedon their 
experiences as former members of the Education- 
al Advisory Staff of Air University, Maxwell Air 
Force Base, Alabama, ina series of previous 
papers* the writer and certain of his profession- 
al associates have attempted to demonstrate that 
systematic emphasis on the improvement of eval- 
uative procedures not only resulted in improved 
evaluations per se but also contributed to im - 
proved objectives of instruction and to improved 
instructional procedures. 

One of these previous papers dealt with the 
sub-hypothesis that the quality of instruction 
could be improved by means of (1) improving ob- 
jective test items, (2) improving the measure- 
ment of intangibles, and (3) utilizing student par - 
ticipation in the evaluation of instruction. 

The evidence that emphasis upon the improve- 
ment of objective test items actually resulted in 
improved evaluations consisted of considerable 
data showing a measurable and statistically sig- 
nificant improvement in such test items as meas- 
ured by increased validity coefficients and by an 
improved functional content of test items on suc - 
cessive tests in the same area of instruction. It 
was further found that improved validity coe ffi- 
cients and improved functional content of test 
items were accompanied by increased ‘‘face val- 
idity’’ of tests, increased student satisfaction 
with the ‘‘fairness’’ of tests and an increased 
critical concern by instructors and students rel- 
ative to the appropriateness of the instructional 
objectives and the teaching procedures employed. 

Time limitations preclude the presentation 
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here of detailed evidence indicating that empha- 
Sis on the evaluation of intangible outcomes and 
on the participation of learners in the evaluative 
process was accompanied by improved evalua- 
tions per se as well as improved objectives and 
improved instructional procedures. It may be 
summarily stated, however, that these evidences 
included such concrete data as changes in the of- 
ficial statements of the objectives of particular 
units of instruction, changes in the amounts of 
time devoted to particular units of instruction, 
and changes in the amount of time devoted to par- 
ticular instructional procedures (i.e., lecture, 
discussion, demonstration, etc.). The evidence 
also included the systematically analyzed judg- 
ments of members of the Educational Advisory 
Staff, of the instructional staff, and of the stu- 
dents themselves. 


Institutional Improvement in the Evaluation of 


Instruction 


Three general suggestions are made relative 
to improved evaluations of instruttion in individ- 
ual institutions of higher learning: 


1. Recruitment—In the employment of instruc- 
tional personnel special emphasis should be 
given to the competencies in evaluation of pro- 
spective employees. 


. In-service training—Considerable evidence in 
dicates that an in-service training program 
can bring about notable improvements in the 
evaluation competencies of instructors 


. Specialized evaluation services—Experience 
in the armed services, in many secondary 
schools and in a few institutions of higher 
learning appear to warrant the belief that pro 
vision by the Central Administration of sp ec- 
ialized evaluation services, available on a 
voluntary basis to members of the instruction 
al staff, tends to bring about not only marked 
improvement in the evaluation of instruction 
per se but also facilitates improved instruc- 
tional objectives and improved procedures of 
instruction. 


#Other published papers in this series include the following: -James E. Greene, "The Evaluation of In- 


struction in Air University," Journal of Psycholozy, XXV (198), pp. 279-297; James E. Greene and War- 
ren G. Findley, "Evaluative procedures Tor Uae Tenovement of Instruction," Educational Record, 1X 
(January 1949), ppe 33-li3 Hugh F. Seabury and Kenneth R. Williams, "Air University Trains Instruc- 
tors," Higher Education, IV (September 15, 19:7), pp. 15-18; Kenneth R. Williams and Alder M. Jenkins, 
"Improving Instruction in Institutions of Higher Education," Educational Record, XX (April 1948),pp. 
145-161. 

















THE ROLE OF EVALUATION IN THE IM- 
PROVEMENT OF PLACEMENT AND 
FOLLOW-UP IN INSTITUTIONS 
OF HIGHER LEARNING 


PAUL I. CLIFFORD 
Atlanta University 
Atlanta, Georgia 


THE PURPOSE of this paper is to examine 
the role that evaluation can play in the impr ove- 
ment of the placement and follow-up aspects of 
personnel services in institutions of higher learn- 
ing. 


Conceptual Framework 





In order to adequately identify the role of 
evaluation in these areas, it is first necessary 
to provide a frame of reference or a setof terms 
into which the discussion can be cast. This con- 
ceptual framework includes precise definitions 
concerning these terms and their interrelations 
which have been accepted by the writer. Evalua- 
tion, in the specific sense used in the present pa- 
per, refers to the various technics and process- 
es which can be utilized to determine the degree 
to which definitely stated and clearly defined ob- 
jectives of the placement and follow-up services 
are being attained. Thus, evaluation includes 
any means by which valid evidence may be col- 
lected and interpreted for the purpose of judging 
the efficacy or value of present procedures that 
are being employed to attain the specific ends of 
placement and follow-up. 

Although placement and foilow-up are som e- 
times considered as distinct services, they are 
inseparable in both theory and practice. Place- 
ment may be defined as a multi-phasic process 
which aids an individual to make those decisions 
concerning an educational or vocational next step 
which will increase the probability that he will 
progress satisfactorily from one educational or 
vocational experience to another. Follow-up is 
the evaluative phase of placement and all the oth- 
er antecedent services involved in the guidance 
and instructional programs of a given institution. 

Placement, in its educational phase, has for 
its major objective the matching of an individual 
student and an array of particular educational ex- 
periences in such a way that the studént will like- 
ly attain maximum benefit. In its vocational 
phase, the aim of placement is to assist the indi- 
vidual to find his appropriate place in the world 
of work. Appropriate, as used here, means a 
job, a vocation, or a profession which (1) is con- 
sonant with one’s interests and other emotionally 





toned preferences, (2) on a level with the config- 
uration of one’s general and specific mental abil- 
ities, (3) makes use of one’s achievements and 
past acquisitions of skills, (4) makes no physical 
demands upon the individual that he cannot satis- 
fy, (5) is personally satisfying or rewarding to 
the individual to the degree that it continually 
contributes to higher levels of personality integ- 
rity and stability, and (6) makes a significant 
contribution to the improvement of the social or- 
der with which the individual is in interaction. It 
must always be borne in mind that placement is 
individually oriented. Its principal focus is al- 
ways the individual who is being placed. FPlace- 
ment should not be confused with either recruit- 
ment or selection. Recruitment, in contrast to 
placement, is concerned primarily with meeting 
the needs of employers for workers or of educa- 
tional institutions for students, while selectionis 
the process, by which, from among many appli- 
cants, certain ones are picked for given and lim- 
ited educational or vocational experiences. It 
Should be apparent that since the foci of the place- 
ment, selection, and recruitment services are 
different, the three terms should never be used 
synonymously or become confused in our think- 
ing. 

Follow-up is conceived of as the continuous 
process of determining, by any valid means, the 
degree to which an individual's educational or vo- 
cational choices are rewarding or satisfying to 
him in terms of the six criteria of appropriate- 
ness identifiedabove. Follow-up services should 
not be thought of as applicable only to the gradu- 
ates of an institution of higher learning but should 
be conceptualized to include the appraisal of the 
degree of educational or vocational adjustment of 
those who have withdrawn before graduation. It 
should be axiomatic that both placement and fol- 
low-up services should be employed with former 
students as long as there is need on the part of 
the individual for these services. 


Basic Assumptions 


At this point, it is necessary to present the 
basic assumptions which the writer has accept- 
ed in the preparation of this paper. The first 
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assumption is that our institutions of higher 
learning are genuinely concerned with develop- 
ing to the fullest extent possible the potentiali- 
ties possessed by each student which they ad - 
mit. If this assumption is valid, it follows, 
then, that our educational enterprises have the 
moral responsibility of using the totality of their 
resources not only to help their former students 
to take the next appropriate educational or voca- 
tional step, but also to determine as validly as 
possible whether the step taken was the one 
most likely to eventuate in satisfaction to the in- 
dividual and benefit to society. 

The second basic assumption is that the only 
means by which a given institution of higher 
learning can determine the degree to which 
its placement and follow-up services are attain- 
ing their objectives is to carry on planned, val- 
id, comprehensive, and continuous appraisals 
of these programs. 

The third basic assumption is that in order 
to evaluate placement and follow-up, the objec- 
tives of these services must not only be clearly 
stated in terms of student behavior, but the par- 
ticular areas of functioning in which the behav- 
ior is expected to take place must also be ident- 
ified. This assumption required us to think of 
the objectives of both placement and follow-up 
as acquisitions of behavior or learnings on the 
part of the individual student which will mater- 
ially increase the probability that he will make 
and continue to make satisfying and reward- 
ing educational and vocational choices after leav- 
ing the educational institution he is presently at- 
tending. 

The fourth basic assumption is that the data 
which are derived from evaluative processes 
which have as their locus the behavior of the in- 
dividual student, must be referred, in the final 
analysis, to the specific opportunities or tasks 
to be performed in educational institutions and 
in the world of work. This reference, or the de- 
termination of the appropriateness of students 
on one hand and vocational and educational op - 
portunities on the other, requires evaluation at 
both poles of the individual—vocational or edu- 
cational spectrum. 


Roles of Evaluation and Follow-Up 
Lf 


In view, then, of the conceptual framework 
and the basic assumptions of this paper, it is 
possible to identify the roles of evaluation in 
placement and follow-up in institutions of high- 
er learning as at least four in number. 

The first of these is to provide basic infor - 
mation about the individual student in terms of 
his general and specific. mental abilities, his 
school achievement, his interests, his person- 
ality integration, his socialization, his physcial 
status, and any other attributes which are rele- 
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vant to success in further educational endeavors 
or in the world of work. In playing this role 
evaluation makes it possible for the psychologist 
or the personnel worker to synthesize a set of de- 
scriptions of the individual’s behavior in these 
various domains in such a way as to get a holis- 
tic psychological picture of the individual’s func- 
tioning as a totality. 

The second role of evaluation in placement 
and follow-up is to provide valid and usable in- 
formation about the approximately 30,000 occu- 
pations in the United States and about the many 
educational opportunities available to stud ents 
who graduate or withdraw from our institutions 
of higher learning. The processes of evaluation 
must be expanded to include the continuous gath- 
ering of valid data about the world of work in 
terms of industrial pursuits and processes, job 
trends, labor supply and demand, and the expec- 
tations that employers have concerning the total 
functioning of their employees. Unless evalu- 
ation plays the second role just identified, its 
first role will be of little avail. Unless a per- 
sonnel worker understands the nature of the oc- 
cupational and educational world, his understand- 
ing of the individual which he is ostensibly help- 
ing to adjust to vocational or educational expecta- 
tions is mere sophistry. 

The third role of evaluation in placement and 
follow-up is to provide a basis for the confluence 
of valid information about the individual and ac- 
curate data about the vocational and educational 
worlds. Evaluation provides the only means by 
which these two kinds of information can be re- 
duced to a set of terms which, at once, are util- 
itarian and capable of providing the stimulation 
for progressively deeper and broader syntheses 
of those seemingly polar considerations. 

The fourth role of evaluation in placement 
and follow-up is to determine in as validandcom- 
prehensive a manner as possible the degree to 
which students have acquired the kinds of behav- 
ior which are associated with educational and vo- 
cational adjustment. In order for this to be ac- 
complished our institutions must make periodic, 
longitudinal studies of at least a representative 
sample of their students’ further educational or 
vocational endeavors. 

Because of individual differences and the var- 
iability of human beings on the one hand and the 
increasing heterogeneity and complexity within 
the educational and vocational! worlds on the other, 
evaluation must be called upon increasingly to 
help determine the appropriateness of the one for 
the other. 

It is quite apparent that the task which the 
writer has set for evaluation in improving place- 
ment and follow-up is a gigantic one. 

We have been attempting, for over half acen- 
tury, to improve our methodological approaches 
to more valid and comprehensive descriptions of 
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the behavior and functioning of human beings. 
We have barely scratched the surface, however, 
in determining how we might use these data that 
we can collect in order to match men and oppor- 
tunities. This, to the writer, is the challenge 
of the future. 

The notion that evaluation can play a role in 
identifying the nature of vocational opportunities 
in America is a relatively novel one. It should 
be possible for psychologists, personnel work- 
ers, job analysts and others to pool their compe- 
tencies in such a way as to produce a classifica- 
tion of occupational opportunities in terms of (1) 
the primary personal attributes which workers 
should possess if they are likely to be success- 
ful in one or more of the various occupational 
families, (2) the degree of general and special 
mental abilities which students must possess if 
they are to learn to function properly within a 
given family of occupations, and (3) the kinds of 
educational achievements which are necessary 
for the student to enter one or more of the vari- 
ous occupational families. It should be pointed 
out here that, at best, we have only made very 
rough beginnings at estimating or guessing what 
the many worker constellations of characteris- 
tics, traits, or attributes required for success 
in our vastly complicated world of work are. If 
we are to improve upon these best guesses, we 
must begin the tremendous task of applying all 
of our modern technics of measurement, evalu- 
ation and assessment to this problem which will 
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continuousiy become more difficult. 


Concluding Statement 


In conclusion, the writer would like to point 
out that one consequence of the wide acceptance 
of the four roles that evaluation can play inplace- 
ment and follow-up, would be the saving of great 
sums of money by business. It has been estimat- 
ed that the misplacement of a single employee in 
a business enterprise can cost from $50 00 \o over 
$20, 000.00 depending upon the level at which the 
misplaced person is functioning. It is presenily 
beyond our capabilities to translate into duiiars 
and cents the loss which business enterprises suf- 
fer in the areas of general employee morale, su- 
pervisory and administrative difficulties, high 
employee turnover, and diminished customer 
goodwill because of poor placement policies. The 
price paid in human unhappiness and in vocation- 
al mal-adjustment is inestimable. 

Another consequence of the acceptance of the 
multi-dimensional roles of evaluation in placement 
and follow-up as identified in this paper could be 
the stimulation of more rigorous andprecise re 
search within the general field of the behavioral 
sciences and the specific fields ofpsychology 
and education. Only as research suggests the 
answers as to how we can better understand man 
on the one hand, and the world in which he lives 
on the other, can we attempt to effecta more 
satisfying rapprochement between the two. 








THE ROLE OF EVALUATION IN SPECIAL 
SCHOLARSHIP SELECTION PROGRAMS 


WESLEY W. WALTON 
Educational Testing Service 


Princeton, 


TIME WAS when the award of a scholarship 
was a matter strictly between a youngster anda 
college. Things are no longer thatsimple. Schol- 
arship selection is rapidly becoming a big busi- 
ness. Third parties, fourth, and fifth now are 
involved. High school counselors screen and 
test candidates. Principals and headmasters ex- 
ecute candidate rating scales and furnish secon- 
dary school records. Testing bureaus in col- 
leges and elsewhere administer secure testing 
programs. Selection committees of college ad- 
missions deans dive into seas of data to reach 
considered judgments as to who should receive 
scholarship awards and who should not. Finan- 
cial analysts determine how much is needed 
to keep the scholar’s budget in the black; and 
corporate sponsors furnish the funds necessary 
to move sponsored scholars happily on their way 
to college and through it. 

How does one filter out of a group of eager 
and notably able scholarship aspirants number- 
ing 60,000, the 600 who can make best use of 
higher education? This was the problem faced 
in the National Merit Scholarship Program in 
1955-56. Or, by what means may we best be as- 
sured that the group of 16,000, as eager and as 
notable as those mentioned above, but withtheir 
sights on Generai Motors National Scholars hip 
awards, are rendered down most equitably to 
10U scholarship recipients? The latter problem 
has been faced for two years in the General Mo- 
tors National Scholarship Plan. 

Let us, for a moment, develop an hypothesis 
that young people in America come to a sophis- 
ticated understanding of the competitive system 
ata tender age. Interest in competing for schol- 
arship opportunities is high. Further, that the 
talented among them seem to adjust readily to 
their own version of sucha system. They are 
willing to take their chances. Finally, that in 
standing up to a nationally competitive situation, 
the candidate’s whole concern is directed to a 
commendable performance as a scholarship can- 
didate. He is so engrossed in the task that it is 
only in passing that he may ‘‘estimate’’ the odds 
against his winning. 

Let us now add to the picture factors which 
may better be assumed than hypothesized. 


1. There are not enough scholarships to go 
around to those who need and deserve them. 
2. A substantial, though small and inadequate, 





New Jersey 


number of young people who need and deserve 
scholarship aid will come through a scholar- 
ship competition successfully. Their accom 
plishments will long redound to the benefit of 
their benefactors, and they will contribute 
their bits to society on a higher plane than 
might otherwise have been the case. 

. Many who need and deserve scholarship aid 
will come through a scholarship competition 
unsuccessfully, and may perforce be keptfrom 
going to college as a result. 


These groups of considerations, as they re - 
late to special scholarship selection programs, 
may bring into focus several ‘‘insomnia breed 
ers’’ experienced by people working in this as- 
pect of evaluation. How may a scholarship selec - 
tion committee be sure that it is being fair and 
just in removing a given candidate from further 
consideration? How does one distinguish minute 
but critical differences among the very top of a 
given ability grouping? What elements go into 
the selection of the very best scholarship risks? 

At least partial answers to these questions 
may be found in the 1955 selection proceedings 
of the General Motors National Scholarship Plan. 
Scholarship selections were made by a nationally 
representative committee of college educators 
and secondary school men. The high caliber of 
its membership may be illustrated by citing the 
combination of President and Admissions Dean 
from all of the following: Vanderbilt, Notre 
Dame, Bryn Mawr, MIT, Dartmouth, Stanford, 
University of Michigan. The Principal of Phil- 
ips Exeter Academy, and the Director of Instruc - 
tion for the Denver City Schools completed the 
membership. Let me now outline the selection 
procedures they used and then share with you 
their answers to three questions over which we 
had been loosing sleep. 

At the outset the CEEB Scholastic Aptitude 
Test yielding separate verbal and mathematical 
scores on a 200-800 scale was administered to 
13,112 high school students in January and March 
1955. After scoring the test papers, total verbal 
and mathematical scores were computed for all 
candidates and candidates were ranked on this 
basis. A cutting score of 1345 (675 verbal or 
mathematical) was set to yield atleast 1000 semi - 
finalists for the available 100 awards. Adjust- 
ments to retain the original ratio between the 
sexes and to assure adequate geographic cover- 
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age brought the semi-finalist population to 1414. 

The next step toward selection involved the 
use of a weighted composite made up of twice 
the verbal score plus the mathematical score 
(with a weight of 2), the candidate’s high school 
class rank relative to class size (with a weight 
of 3), a scaled rating by the school principal on 
the candidate’s academic ability (with a weight 
of 1), and a scaled rating by the school princi- 
pal on the candidate’s personal and social adjust- 
ment (with a weight of 2). Suchacomposite was 
computed for the 1414 semi-finalists, and the 
ranking of candidates within the state accord- 
ingly led to the choice of about 500 finalists. At 
this point, to assure fairness and equitable hand- 
ling, two categories of those semi-finalists fall- 
ing below the cutting composite score for final- 
ists were reviewed. Those cases with very high 
SAT scores and those identified as class vale- 
dictorians were studied and included in the final- 
ist group if it seemed propitious to do so. The 
finalists, with these additions, number 585. 

The final step for the selection of the 100 win- 
ners was built on subjective, intensive reading 
by the selection committee of the 585 finalist 
case files. Each file contained two descriptive 
forms, one completed by candidates about them - 
selves and the other on their behalf by principals. 
Committee members worked in teams of two, 
each reading folders independently, and, on as- 
sessing the candidates’ personal qualities, made 
a joint evaluation on the following four - point 
scale: (1) select, willing to defend, (2) select, 
(3) borderline between winner and non-winner, 
and (4) non-winner. These four points were 
used as ratings and were given numerical values 
of an order comparable to the scale scores used 
to rank finalists. Thus, subjective ‘‘clinical’’ 
evaluation had equal weight with objective ‘‘ac- 
turial’’ evaluation. The sum of these evalua- 
tions then became the basis for the final ranking 
of candidates. After resolving ties and accom- 
modating unfilled state quotas, the Committee 
recommended the top 100 for awards and 152as 
alternates. Of the 100 General Motors National 
Scholars for 1955, 62 were on the list of 100 rec- 
ommended for award, 18 were drawn from the 
alternate list. 

The foregoing experience has suggested sev- 
eral considerations which may be regarded as 
partial answers to the questions previously 
raised. 


How may committees be sure of fairness in re- 
moving a candidate from further considerationas 
a scholarship competitor? 
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1. Use a scheme of successive hurdles with at 
least some hurdles having multiple criteria. 
2. Pass over each hurdle a large number of re- 
maining competitors. (Large in comparison 
with the number of available scholarships. ) 
. Provide by-passes to feed back into the com- 
petition those cases for whom ‘‘composite 
predictions’’ may mean injustice. 


How does a scholarship committee make dis- 
tinctions among highly competent competitors for 
scholarship? 


1. Eliminates as rapidly as possible those who 
with fairness may be eliminated so that ener- 
gies may be directed on finite evaluation 
among those of extreme competence. 

. Uses test instruments which will provide a 
spread of scores at the top end of the distribu- 
tion. 

. Ties criteria tightly to the purposes set by the 
donor group and orders the criteria in accord- 
ance with the relative importance tothe group, 
and weights evaluation accordingly. 

. Brings a wide variety of evidence—test and 
non-test—to bear on focusing differential and 
distinguishing traits. Draws this evidence 
from the candidate through personal data 
sheets, from his principal and teachers 
through a secondary school record and staff 
rating sheet. 

. Uses a dual approach involving both objective- 
ly predictive and clinically analytical types of 
activity. 


What goes into the selection of best scholarship. 
risks? 


1. Adequate means for reducing a varied popula- 
tion having a wide geographic spread, varied 
academic and personal characteristics to a 
basis for comparability. 

. Systematic analysis of known predictive fac- 
tors as they relate to the scholarship candi- 
date and his chances for college success. Re- 
duction of the prediction to quantitative terms. 

. Intense study of secondary school level of per- 
formance, academic, extra-curricular, com- 
munity and otherwise, and an estimate of what 
this means in terms of college and post-college 
activity. 

. Determination of an ‘‘index of likely success’’ 
against which to measure a number of college- 
going potentials and from which to break into 
the open those who are best risks for spon- 
sored scholarships. 





THE ROLE OF EVALUATION IN THE DEVEL- 
OPMENT AND IMPROVEMENT OF REGION- 
AL PROGRAMS OF HIGHER EDUCATION 
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; Atlanta, Georgia 


EVALUATION PLAYS a very important part 
in the development and improvement of regional 
programs in higher education. In this paper I 
shall discuss the subject within the general frame- 
work of the operations of the Southern Regional 
Education Board. The activities of the Board con- 
stitute a systematic andcoordinatedapproach to 
the development and improvement of higher educa - 
tion in the fourteen states in the South. The concept 
of evaluation as it applies to the activities of the 
Board involves less of precise measurement and 
testing than is indicated in the preceding papers. 
It involves the identification of higher education- 
al needs in the region, the determination of ex- 
isting facilities to provide for the needs and pro- 
posals for bridging the gap between the needs 
and present facilities. 

To consider the role of evaluation in the set- 
ting of the Southern Regional Education Board 
it is necessary to first summarize the major 
functions of the Board. Briefly stated, they are: 
(1) to serve as a clearinghouse for information 
on regionally significant activities in higher ed- 
ucation; (2) to provide facilityand staff for as- 
sessing needs and developing programs to meet 
needs of higher education in the South; (3) to ad- 
minister inter-state arrangements for regional 
education services in institutions; (4) toact as 
fiscal agent in carrying out such arrangem ents; 
(5) to serve as a research facility on institution- 
al and regional problems related to the improve- 
ment of higher education; and (6) to assist inpro- 
viding consultative services to states and insti- 
tutions on probiems of major regional signifi- 
cance related to the improvement of higher edu- 
cation in the South. 

A paper of considerable length would be re- 
quired to discuss adequately the role of evalua- 
tion in relation to each of these functions. In or- 
der that I may stay within the limits of the time 
allotted I shall focus my presentation primarily 
on the second and fifth of the functions I noted; 
namely, assessing needs and developing pro- 
grams to meet needs of higher education in the 
South and to serve as a research facility on in- 
stitutional and regional problems related to the 
improvement of higher education. I shall also 
note briefly the necessity for appraising and 
marehalling social forces inorder that programs 
of action may be effected. 





To assess the needs and develop programs to 
meet the needs of higher education in the Southis 
an evaluative task of major magnitude. It in- 
cludes research to project as accurately as pos- 
sible population growth and economic develop- 
ment as a basis for forecasting undergraduate 
and graduate enrollments and for determining 
the need for technically and professionally trained 
personnel in the light of economic changes. From 
these facts are determined the needs for new fac- 
ulty members, new educational programs, in- 
creased physical facilities, and additional finan- 
cial resources. The approach to a problem of 
this kind is complicated by the variables involved. 
First of all the statistical techniques employed 
must be defensible or else all of the conclusions 
derived from the data will be open to question. 
Second, certain assumptions whose validity has 
not been demonstrated must be made. For exam- 
ple, it is estimated that the Southern region faces 
a deficit of between 27,000 and 28,000 college 
faculty members by 1965. This is an evaluative 
judgment based on statistical evidence. The evi- 
dence includes the projected growth in enroll- 
ments in colleges and universities of the South, 
the faculty-student ratio, the teaching loads typi- 
cal of Southern institutions, and the potential out- 
put of college teachers by the universities of the 
South. There are other assumptions too that have 
to be made—such as the rate of student migra- 
tion into and out of the South and the percentage 
college age youth who will enter college. The val- 
idity of some of the assumptions has not been es- 
tablished, therefore the conclusions must remain 
tentatiy 2. 

The Board is also called upon to determine 
needs for programs in various professional 
fields. For example, within recent years the 
question arose in one state as to the need fora 
school of architecture and in another state as to 
the need for a veterinary medical school. In each 
instance the Board was asked to assess the needs 
on a regional basis and to advise the states con- 
cerning the proposed programs. In both cases it 
was shown that the regional facilities for training 
people in these fields were adequate and that the 
states could much more economically use region- 
al facilities than provide duplicate programs of 
their own. During the first seven years of the 
Board’s operation more than thirty professional, 
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technical, and graduate fields have been ex- 
plored. To assess needs in these fields the 
Board must endeavor to find answers to many 
questions that will throw light on the current sta- 
tus of the field under consideration and the fu - 
ture needs in the field. Such questions as the fol- 
lowing are illustrative: 


1. What is the potential demand for profession- 
ally trained personne} in this field? 

2. What is the potential student demand in the 
field’? 

. What is the present student capacity of insti- 
tutions in the region offering programs in the 
field? 

. What is the quality of existing programs in 
the field? 

. To what extent do existing programs in the 
field provide complementary or duplicate 
opportunities for specialization? 

}. What cooperative arrangements among insti- 
tutions and states would allow compl em en- 
tary strength of institutions to be combined 
or developed? 

. What additions, if any, are needed to improve 
the quality or to increase the capacity in the 
field in order to serve the needs of the region? 

. How can the interests and resources of indus- 
try, foundations, state and federal agencies 
be correlated with the special field so as to 
improve the quality of research and teaching 
and broaden the range of institutional ser- 
vices? 

9. What previous experience of institutions and 
government can be drawn upon in assessing 
current needs in the field? 


In assessing needs the first step is to ident- 
ify the field of specialization to be c onsidered, 
then to formulate the kinds of questions just not- 
ed. Priorities must also be established among 
the fields under consideration. The priorities 
of subject matter fields arrived at by the South- 
ern Regional Education Board are determined 
largely on the basis of which fields will most 
likely elicit a response from the colleges and 
universities, state governments, andthe gen- 
eral public. Once the fields to be assessed have 
been determined, the next step is to decide on 
the procedure to be followed in answering the 
questions. This phase of the evaluation can best 
be presented by referring to specific instances 
in which the process has been completed. One 
of the best illustrations is in the field of nursing 
education, 

This project grew out of an action taken by 
the Southern Regional Conference of State Leagues 
of Nursing Education at its meeting in Atlanta on 
November 11, 1950. The motion passed at that 
meeting read: 





That the Board of Control for Southern 
Regional Education be asked to appointa 
commission on nursing education as soon 
as possible for the purpose of studying 
nursing education and identifying the ways, 
if any, in which regional arrangements 
would be beneficial. 


Other nursing groups gave strong support to 
this request. In response to the request the 
Southern Regional Education Board appointed a 
Committee on Nursing Education. The functions 
of this committee were as follows: 


1. To assess regional needs for expansion and 
improvement of nursing education through 
a. Identifying needs for nurses able to execute 
various responsibilities; 
b. Identifying kinds and capacities of training 
facilities needed to meet these needs; 
. Identifying needed research and other activ- 
ities; 
. Defining the gaps between present facilities 
and needed facilities, both in scope and 
quality. 


. To propose sound and feasible means of meet- 
ing identified regional needs through 
a. Action by the nursing and medical pr ofes- 
sion; 
b. Action by individual states or institutions; 
c. Action by groups of states or institutions. 


The committee appointed by the Board had a 
two-day meeting in October 1951, at which were 
discussed the regional needs for nursing educa- 
tion, including the need for research which is rec- 
ognized to be of fundamental importance to the 
sound development of the profession. From this 
meeting emerged several suggestions: 


1. That regional arrangements for nursing educa- 
tion providing for graduate study to the level 
of the master’s degree be considered by repre- 
sentatives of collegiate schools of nursing 
meeting with representatives of the Board. 

. That the same group also consider the possi- 
bility of establishing a center in the Southern 
region which would conduct research in nurs- 
ing, act as a clearinghouse for research, and 
assist in preparing persons to do research in 
this professional field. 


At the same meeting it was recommended that 
a competent person be employed to study the needs 
more thoroughly and to determine, after visits 
and the compilation of data, which universities 
seem at present best qualified to serve the re - 
gion by offering graduate education in nursing, 
and also which universities seem best prepared 
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to direct research, service, and education. The 
professional staff person appointed in accord- 
ance with the Committee’s recommendation, in 
consultation with representatives of various pro- 
fessional groups, prepared a questionnaire de- 
signed to discover which of the universities in 
the region were interested in offering such ser- 
vices as were contemplated and what character- 
istics of these schools appeared to support their 
readiness to begin such service. The data pre- 
sented by the universities which indicated such 
an interest were analyzed, summarized, and 
studied. Subsequently, the professional staff 
member on the project visited each school for 
the purpose of testing by direct observation and 
interviews the findings derived from the initial 
questionnaire study. The findings and conc lu- 
sions thus reached were presented ina con fer- 
ence of representatives of the institutions ha v- 
ing basic degree programs in nursing in 1952. 
From a list of eleven schools that initially ex- 
pressed an interest in providing graduate pro- 
grams in nursing or in establishing a research 
institute, six were finally selected. The criter- 
ia employed in making the final selection of 
these institutions were: 


. An institution of higher education of recog- 
nized academic and professional standing; 


. Institutional interest in graduate work as ev- 
idenced by an existent graduate council, dean 
and faculty and provision for inter-depart- 
i ental communication. 

. Availability of a reference library of ample 
size and quality according to aecepted stand- 
ards, including its building. 

. Evident appreciation of the educational and 
health needs of the Southern region and a feel- 
ing of institutional responsibility to meet 
these. 

. A climate of opinion favorable to the develop- 
ment of professional programs as these 
mighi va. y trom traditional programs of grad- 
uate work. 

. Presumption of some ability to contribute to 
financial support of this additional field of 
graduate study. 

. Availability of services such as counsel ing, 
housing, recreation, and the like, inaddition 
to instruction. 

. The existence of an autonomous school or col- 
lege of nursing with a sound basic baccala u - 
reate program, preferably already nationally 
accredited 

. Opportunity for ample clinical experience of 
high quality, including public health, and op- 
portunity to study well individuals in addition 
to those who are ill. 


Now six universities are in the process of de- 
veloping advanced programs in nursing education 
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leading to the master’s degree. 
This approach has had several important bene- 
ficial results. Among them are the following: 


1. It has brought together representatives of the 
profession of nursing education and of the uni- 
versities to explore jointly the needs in this 
field and to identify the resources of the re- 
gion to meet the needs. 

. It has been a means of securing financial sup- 
port from two of the major foundations. The 
Kellogg Foundation has provided approximate- 
ly a half million dollars fora five-year period 
to underwrite the cost of instruction. The 
Commonwealth Fund has provided scholarship 
and fellowship funds in the amount of twelve 
thousand dollars annually to each of the six 
schools. This fellowship program is now 
in its third year. The Commonwealth Fund 
ha: also provided from twenty-three to twenty 
four thousand dollars for each of the first two 
years for the conduct of seminars. It is anti- 
cipated that this support will be continued on 
a reduced scale with the idea that the seminars 
should eventually become self-supporting. 


With reference to evaluation, one further fact 
needs to be noted. A special evaluation c ommit- 
tee has been appointed to make an annual apprais 
al of the progress of the seminars and of the edu- 
cation project. Also, forms have been developed 
for recording the progress of students, and plans 
are underway to follow up for a period of several 
years individuals who complete the programs and 
enter positions in the field of nursing education, 
Finally, a plan is being developed for a full eval- 
uation of the project at the end of a five-year per- 
iod, the term of the Kellogg grant. This is anex- 
cellent illustration of the development of a pro- 
ject in which evaluation is basic. 

Now may I turn to a second illustration of a 
somewhat different nature. I refer to the South- 
ern Regional Education Board’s project in mental 
health. In the fall of 1953 the Southern Gover- 
nors requested the Southern Regional Education 
Board to study the needs and resources in train- 
ing and research in mental health programs of 
the sixteen states. This project grew out of are- 
port on the training and research in state mental 
health programs prepared by the Councilof State 
Governments. The directive to the Southern Re- 
gional Education Board from the Governors pro- 
vided that the Board: 


Begin an immediate survey of facilities 
for the training of psychiatric personnel in 
the South, and that it report to this Confer- 
ence those institutions best qualified to take 
additional students in the psychiatric disci 
plines from states which have no such train- 
ing facilities. 
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That the Board also initiate a survey of 
institutions doing mental health research 
in the South, and that it recommend to 
this Conference those institutions cap- 
able of being enlarged to do addtional re- 
search. 


That upon completion of the above sur- 
veys by the Board, but in any case not 
later than July 30, 1954, a Southern Re- 
gional Mental Health Conference be held 
to discuss the surveys and to draw up in- 
terstate contracts in mental health re- 
search and training. 


That in the interim the individual states 
make official surveys of their training 
and research facilities with particular 
emphasis on raising the mental institu- 
tions in every state to the level of resi- 
dency or affiliate accreditation, and that 
results of these surveys be presented to 
the 1954 Regional Mental Health C onfer- 
ence. 


That the Southern Regional Education 
Board be requested to report the results 
of this study and any action taken to the 
1954 Southern Governors’ Conference. 


A commission composed of fourteen dis tin- 


guished persons representing professional or po- 


litical interests in mental health was appointed 
to define the objectives and to determine the 


scope of the project. State committees appoint- 
ed by the governors of the several states gath- 


ered data in their respective states on mental 
health needs in relation to resources and fac i1- 
ities available, and drafted specific recommen- 
dations. A director of the total project and his 


staff put together the findings of the state com- 


mittees and added data gathered on a regional 
basis in order to get a total picture of mental 
health needs and the present resources to pro- 
vide for these needs in the region. 

Five technical panels were also set up togive 


attention to special problems not covered by state 


surveys. Each panel presented its findings to 
the commission. The Conference on Mental 
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If time permitted I could review the proced- 
ures employed in assessing needs and resources 
to provide for them in many otherfields. The 
plan of organization varies from one project to 
another, but generally the process includes the 
identification of the problems, the gathering of 
pertinent data, the interpretation of the data, the 
formulation of appropriate recommendations, 
and the development of plans for giving effect to 
the recommendations. Not infrequently, as in 
the case of nursing education, these plans also 
require the identification of institutions in the re- 
gion that are most competent to undertake specif- 
ic research or training programs. 

The second kind of evaluation with which this 
paper is especially concerned pertains to re- 
search that will aid in the improvement of instruc - 
tion, organization, and administration in higher 
education. In 1951 the Board invited a group of 
educators from the Southern region and several 
consultants from outside the region to consider 
the problems of institutional self-evaluation. The 
net outcome of this and subsequent conferences 
was the publication of a manual entitled, ‘‘Im - 
proving Graduate Education: A Guide to Insti- 
tutional Self-Evaluation. ’’ 

The impact of this approach was relatively 
limited. Now the Board is moving in the direc- 
tion of more directly promoting research and ex- 
perimentation in higher education. This is an- 
other approach to protecting and improving the 
quality of higher education. The Board foresees 
that the quality of higher education will be threat- 
ened by the impending tidal wave of students and 
believes that now is the time to examine the val- 
idity of the premises on which the colleges and 
universities operate. This approach points in 
three directions: intra-institutional, statewide 
inter-institutional, and regional studies. 

The nature of needed studies and experiments 
is suggested by the major problems confronting 
higher education in the United States, namely, 


1. Impending critical shortages of both the sup- 
ply and quality of college teachers. The need 
therefore, to hold and to make more effective 
use of superior teachers. 

. The growing complexity of the curriculum re- 
flected in increased offerings of fractionated 





Health Training and Research, attended by some 
170 persons, held in the summer of 1954 re- 
ceived the findings and recommendations of the 

state committees, the technical panels, and the 

staff. Finally, in September 1954 the findings 
and recommendations previously developed were 
presented to 56 legislators from the Southern Re 
gional Compact states for their critical study. universities and the duplication of expensive 
They endorsed the recommendations and com - and highly specialized programs within the 
mended them for consideration by the Gover- region. 

nors of the sixteen states concerned. Now these 
recommendations are being put into effect. 


and specialized courses. 

. The employment of conventionalized methods 
of instruction. 

. The cumbersome plans of institutional organ- 
ization and management. 

. The unnecessary and uneconomical duplica- 
tion of programs among state colleges and 





The delineation of these problems implies the 
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the urgent need for carefully controlled research 
and experimentation in such areas as the se lec- 
tion, preparation, and use of faculty members, 
curriculum re-organization, methods of teach- 
ing, intra-institutional and inter-institutional or- 
ganization and administration. To be more spe- 
cific, what combination of qualities and proced- 
ures makes for superior teaching, what isa rea- 
sonable faculty load, what use can be made of 
television and other audio-visual aids to extend 
the compass of superior teachers, how canecon- 
omies and improved effectiveness be achieved 
through curriculum organization, what plans of 
space construction and utilization contribute to 
increased effectiveness and economy, what are 
the merits and limitations of various plans of in- 
stitutional and statewide administration? With 
reference to the research and experimentation of 
the kind just outlined, the Board will serve as 
the facilitating agent. It will stimulate institu - 
tions and state boards to explore these problems 
and, on request, will aid in designing appropr i- 
ate research and experimentation. The Board 
itself will undertake projects in this area only 
as it is requested to do so by the institutions 
and the states of the regions. The Boardis still 
in the early stage of promoting the much needed 
evaluative research and experimentation in this 
area. 

The anticipated outcome of the Board’s pro- 
jects is generally a program of action. But in 
order that the Board may achieve its predeter- 
mined purposes it must identify and gear itself 
into the dynamic and powerful elements of the cul- 
ture of the states and of the region. Especially 
important is the appraisal of these cultural com- 
ponents as to their relative importance, their 
favorable or antagonistic attitudes, and the pos- 
sibility of melding them into a régional pattern. 

Two of the most important of these elem ents 
in the Southern region are state governments and 
the colleges and universities. How to appraise 
the relative dynamics of these two elements and 
how to fuse or coordinate them in the interest of 
the social and economic development of the South 
is one of the Board’s major problems. Two main 
methods of assessing these cultural forces have 
been employed: viz., the judgment of educational 
and political leaders and practical experience; 
neither of them scientific in the strict sense of 
the term. To gear into the dynamics of admin- 
istrative personnel in sta*e governments has pre- 
sented no great problem because the Southern 
Regional Education Board is the agent of the states 
and was created by the governors of the compact 
states. But the election of a new governor, one 
who had nothing to do with the creation of the 
Board and who knows little about its functions, 
may greatly impair the dynamic power of the 
group. Such a situation immediately requires 
the identification of avenues through which the 
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governor may be given an understanding of the 
Board’s program and may become favorably dis- 
posed to it. 

To tie the Board’s program into the legislative 
bodies of the states is another matter. One ap- 
proach that the Board has developed is the Legis- 
lative Work Conference—a conference in which 
about 60 legislators from the compact states take 
part each year. Consideration of regional prob- 
lems in higher education by this group has been 
an important means of creating common inter- 
ests and understandings that transcend state 
boundaries. 

An appraisal of these procedures has indicat- 
ed, however, that the higher institutions through 
their presidents and boards of control must some- 
how be brought into the picture more directly. 
This is especially difficult because of the variety 
of plans for the administration of state-supported 
higher institutions. One idea that is being tried 
experimentally is to request the presidents of un- 
iversities who are members of the Southern Re- 
gional Education Board to invite members of their 
boards of control to attend the Legislative Work 
Conferences. Whether this will be a means of 
fusing another element into the regional pattern 
the Board is attempting to develop remains to 
be seen. If the plan appears to be sufficiently 
promising it may be extended to include members 
of boards of control of other universities in the 
region. 

It seems quite clear that as time goes on it 
will be necessary to identify other dynamic ele- 
ments in the culture pattern of the South and to 
attempt to marshal their forces in support of the 
Board’s program. There may be better methods 
for doing this than those which the Board has re- 
lied upon but so far those better methods have not 
come to light. 

It is important to note that the Board's contin- 
uing assessment of higher educational needs in 
the South and the development of programs topro 
vide for identified needs currently involves about 
twenty committees and commissiorts with a total 
membership of nearly 300 professional and lay 
persons. This number does not include partic i- 
pants in the Legislative Work Conferences that 
are held from time to time. Significant also are 
some of the outcomes of these exploratory and 
evaluative activities; for example, contract pro- 
grams among selected universities of the region 
in the fields of dentistry, medicine, social work, 
and veterinary medicine now enroll about 1000 
students to whom the advantages of education in 
these professional fields were not available in 
their respective states; and memoranda of agree- 
ment among universities offering specialized 
programs in city planning, forestry, marine sci- 
ences, nursing, petroleum sciences, and pulp 
and paper have already been adopted. Explora- 
tory studies still underway will in all probability 
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lead to additional memoranda. From these ac- 
tivities have also come publications and consul- 
tations designed to aid institutions and profes- 
sional groups in identifying problems and in find- 
ing solutions to them. 

I have sketched very briefly three types of 
evaluation that are involved in the development 
of regional programs of higher education—a s - 
sessing regional needs and resources to meet 
those needs; stimulating and aiding institutions 
to assess by research and experimentation the 
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basic premises underiying instruction, curricu- 
lum organization, and administration; and as- 
sessing the dynamic elements of a regional cul- 
ture pattern that may be drawn upon to put pro- 
granis into effect. I have also indicatedinafew 
words some of the achievements in a regional 
approach to the improvement of higher educa- 
tion. These illustrations will suffice to support 
the statement I made at the beginning, namely, 
evaluation plays an important role in the devel- 
opment of regional programs of higher education. 





THE ROLE OF SIXTEEN MILLIMETER MO- 
TION PICTURES AND PROJECTED STILL 
PICTURES IN SCIENCE UNIT VOCABL- 
LARY LEARNING AT GRADES FIVE, 
SIX, AND SEVEN 


LOUIS ROMANO 
University of Wisconsin 


Definition of the Problem 





THIS STUDY is an attempt to identify the role 
of sixteen millimeter motion pictures and pro- 
jected still pictures in science unit voca bulary 
learnings in grades five, six, andseven. This 
study specifically attempts to find possible 
answers to these questions: (1) Do children 
learn more of the vocabulary of science units 
when motion picture films and projectec still 
pictures are added to the use of other audio-vis- 
ual materials? And (2) do children retain more 
of the vocabulary of a science unit when motion 
picture films and projected still pictures are 
added to the use of other audio-visual materials ? 

The subjects in this study were boys andgirls 
from two fifth, two sixth, and two seventh grade 
groups in the public schools of Shorewood and 
Whitefish Bay, Wisconsin. These groups were 
rotated so that each scrved in turn as an experi- 
mental and a control group. Blackboards, bul- 
letin boards, charts, models, flatpictures, and 
ficld trips were used both in the control and ex- 
perimental situations, but motion pictures and 
projected still picturcs (filmstrips 2 x 2 and 
3-1/4 x4 slides, and pictures used with the 
opaque projector) were uscd only in the experi- 
mental situations and served as the experim en- 
tal factors. Vocabulary test results, supple- 
mented by the reactions of teachers and students, 
provided the means of judging the contributions 
of the experimental factors. 


Significance of the Problem 





It should be pointed out that this study does 
not attempt to determine the effectiveness ofa 
Single audio-visual material over other visual 
materials such as slides, demonstrations, maps, 
and the like, or the more traditional classroom 
procedures using verbal instruction by means 
of textbooks or supplementary reading. Instead, 





it attempts to determine the effectiveness of an 
audio-visual utilization in which several audio- 
visual materials are employed over an audio-vis-~ 
ual utilization in which a limited number of audio- 
visual matcrials are used. Dal.!* states that 
experimentors often neglect to establish normal 
schoolroom procedures in their investigation 
which may result in lessening the value of the it 
data. The procedures in this study seem to fol- 
low a realistic classroom situation Many 
schools use some audio-visual materials, but ac- 
cording to various surveys many schools do not 
have an audio-visual program which includes 
the use of several audio-visual materials in the 
instructional program. If the findings of this 
study should point out that better learning is 
achieved when certain audio-visual materials 
are employed throughout a unit of study, it might 
suggest that these materials be included as anin- 
tegral part of the instructional program 

In previous experiments, emphasis was 
placed on the values of films for imparting fac- 
tual information. 2 This study may tend to give 
evidence that the use of audio-visual materials 
in the instructional program contributes to bet- 
ter learning experiences. Educators cannot re- 
frain from producing research that points out the 
effectiveness of an instructional tool. This ises- 
pecially true because many magazine articles 
and newspaper stories point out the public’s con- 
cern for the teaching of the fundamental skill: 
The findings of this study may be used by educa- 
tors in informing the public that the use of audio- 
visual materials helps children in gaining the vo- 
cabulary comprehension which is vital to any 
basic skills program 

Classroom teachers are concerned about the 
ability of boys and girls to acquire and retain 
the vocabulary taught during an instructional 
unit of study. The findings of this study may 
point out that the vocabulary of a unit of study 
may be learned when an aggregate of audio-vis- 


"All footnotes will be found at the erd of this article. 
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ual materials as defined for the experimental 

group is used in the teaching-learning situation. 
Learning the vocabulary of the unit of study for 
the purpose of knowing words per seis not as 
important as knowing the words which will be 

used to grasp the important concepts, under- 
Standings, or generalizations of the unit of study. 
Acquiring the vocabulary in the unit of study 
might help children grasp the meanings of the 

generalizations more readily. 


Limitations of the Study 





In spite of careful planning by the partici pat- 
ing teachers and the investigator, this study is 
not without limitations. 

Probably the most obvious limitation might 
seem to be the small number of students from 
which the data was obtained. This study was lim- 
ited to the collection of data in the present situa- 
tions, and is best described as a descriptive 
study. 

Another limitation grows out of the fact that 
this study is limited to boys and girls in the mid- 
die to upper class cultural backgrounds. Both 
communities, Shorewood and Whitefish Bay, en- 
joy many Cultural and social advantages which 
one might not find in a large city with its hetero- 
geneous population. 

A further limitation is found in the vocabulary 
tests. They were primarily developed as r ecog- 
nition tests and they do not in any way tell how 
children should use these words. 

The vocabulary words in the objective tests 
were obtained from the text materials included 
in the science units as taught in the fifth, sixth, 
and seventh grades. A more comprehensive pic- 
ture would have included determining whether or 
not children acquire and retain the vocabulary in 


other subject areas such as social studies and the | 


language arts. To a certain extent vocabulary 
used in the science unit of study is also included 
in other areas of study, but this is limited. 

A limited number of appropriate films and 
filmstrips for various units of study in elem en- 
tary science made it ‘difficult for the partici pa t- 
ing teachers to obtain the best audio-visual mate- 
rial for the instructional program. 


Procedures Employed in this Study 





Rotation Technique. The rotation-group tech- 
nique of experimentation was used in order to 
minimize the effect of several uncontrollable fac- 
tors such as initiative, industry, or study habits. 
The rotation method ‘‘,...involves an exchange 
for the groups at intervals, in terms of thepro- 
cedures followed. '’4 This technique was used 
with both the classes and the teachers. During 
each unit of study for each grade level, one class 
was designated as the ‘‘control’’ group while the 
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other class was designated as the ‘‘experimental” 
group. The ‘‘control’’ groupwas the group 
which used only the following audio-visual mate- 
rials: bulletin boards, blackboards, charts, 
models, flat pictures, and fieldtrips. The ‘‘ex- 
perimental’’ group not only used the materials 
listed for the control group, but also used six- 
teen millimeter motion picture films and project- 
ed still pictures. 

Selection of Groups Participating. Equal num- 
bers of children in the fifth and sixth grades 
from the Lake Bluff School of Shorewood, Wis- 
consin, and from the seventh grade from Cum- 
berland School of Whitefish Bay, Wisconsin, 
were included. These groups were equated with- 
in feasible limits on the basis of I.Q. scores and 
standardized reading vocabulary test scores. 

The Selection of the Vocabulary Words andthe 
Construction of Tests. Prior to the experiment, 
the investigator reviewed all of the science text- 
books from the third grade level through the 
ninth grade level to assemble the vocabulary es- 
sential to the understanding of the core ideas to 
be developed within a unit of study. In addition 
to looking through the available textbooks, the in- 
vestigator reviewed each article in the World 
Book Encyclopedia 9 that pertained to a particu- 
lar unit of study. A review by the investigator 
of all the available textbooks in each of the par- 
ticipating schools from the third grade level 
through the ninth grade level, was designed to 
provide a range of science words from the third 
through the ninth grade level. 

These lists of words were then carefully re- 
viewed by a committee made up of teachers par- 
ticipating in this study. Also, teachers who were 
especially interested in the teaching of science 
and had had several years of experience in this 
field, were asked to check this list of words care- 
fully. After the vocabulary lists were approved 
by this committee, test items were deve loped 
which included all of the words in the list. In 
each unit approximately 250 words were record- 
ed. This made possible the construction ofa 50- 
item vocabulary test. Wherever possible a word 
meaning nearly the same as the key word was ob- 
tained from the list of 250 words. For example, 
part of the vocabulary from the sixthgrade unit 
of study, Sound, includes the following: 














reception loudness 
range spread 
transmit mute 
amplitude intensity 
supersonic audio 


decrease 
velocity 
speed 
amplify 


From the above list, the committee of teac h- 
ers selected and designated the word ‘‘velocity ” 
as a key word. The test item then included five 
different words, one being the correct answer. 
Whenever possible a word which had the same, 
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or nearly the same meaning was obtained from 
the list of 250 words. This word was considered 
the correct response. 

The tests used as instruments of measure in 
this study were of the multiple-choice objective 
type. 

Validity and Reliability of the Test Items. A 
high degree of curricular validity could be as- 
sumed since the vocabulary was closely correlat- 
ed with the curricular content of each unit of 
study. 

Reliability was estimated by administering 
the vocabulary tests to groups not participating 
in this study. The split-half method was used. 
This necessitated obtaining separate scores on 
odd and even-numbered items. A coefficient 
of correlation was obtained between these two 
scores by the product-moment method. By 
means of the Spearman-Brown formula, an esti- 
mate of the reliability of a test as longas the two 
halves combined was obtained. 

Administration of the Vocabulary Tests. Pri- 
or to teaching the science units, tests for each 
grade level were given to the control and experi- 
mental groups. These tests were administered 
two hours apart so as to reduce practice effect. 
The scores are designated asthe ‘‘pre-test 
scores’’. At the termination of each unit of study 
which took five weeks, ‘‘final tests’’ were given. 
Six months after the ‘‘final tests’’, the partici- 
pants were given the same test. These scores 
are designated as ‘‘re-test scores’’. 

To insure objectivity, teachers involved in 
this study did not check these papers. Objective 
answer sheets were worked out, and all tests 
were scored on the basis of these answer sheets. 

The Selection of the Science Units of Study. A 
committee of teachers selected two units for 
each grade level based on the following criter ia: 
(1) availability of audio-visual materials related 
to the various units of study, and (2) extent of 
previous experiences in the particular unit of 
study. Specific problems to be covered in each 
unit of study were defined by the teachers so as 
to insure some degree of uniformity in both ex- 
perimental and control groups. 

The Selection of Audio-Visual Materials for 
the Experimental Group. The criteria deter- 
mined by the participating teachers included: (1) 
Does the audio-visual material contribute to the 
objectives of the unit of study? (2) Does the au- 
dio-visual material suit the experiences, inte l- 
lectual maturity, and grade level of the students ? 
(3) Is the audio-visual material accurate and au- 
thentic? (4) Is the audio-visual material signifi- 
cant? Any audio-visual materials previewed 
that did not meet the above criteria were not 
used in this study. 

The procedure for showing audio~visual mate- 
rials was carefully planned by the group. Such 
procedures were demonstrated in an in-service 
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meeting. 

Procedure in the Selection of Pupiland Teach- 
er Responses. Subjective evidence was gathered 
on the reactions of pupils and teachers to the util- 
ization of audio-visual materials in the 
classroom. Specifically, teachers were asked 
to respond in writing to the following question: 
‘‘What reactions do you have concerning teaching 
a unit of study inwhicha limited number of audio- 
visual materials are used as contrasted with a 
Situation inwhichseveral audio-visual materials 
are used. ’’ The reports were then submittedat the 
termination of the ten-week experimental period. 

The boys and girls were asked to react to the 
following question: ‘‘What reactions do you have 
concerning the first unit of study in science and 
the second unit of study?’’ Responses to this 
question were recorded immediately by the par- 
ticipating teachers, or, when possible, a stenog- 
rapher was employed. 





Presentation of Findings and Interpretation: 
Test Results 





The findings for the fifth, sixth, and seventh 
grade groups using the rotation-group technique 
are summarized in Table I. 

Table I points out that the fifth grade classes 
in the unit on Electricity hnda meanscore of 
7.24 words on the pre-test for the experimental 
group, anda mean score of 11. 45 for the control 
group. In the final test scores given five weeks 
after the pre-test, the experimental group 
scored a mean of 23. 62 words while the control 
group scored a mean of 21.93 words. Inthis par- 
ticular unit the experimental group had a mean 
gain of 16.38 while the control group had a mean 
gain of 10.48. The experimental group in the unit 
on Electricity had a mean gainof 5. 90 words over 
the control group. 

In the unit of study, Rocks, the experimental 
group had a mean pre-test score of 15. 06 while 
the control group had a mean pre-test score of 
17.40. In the final tests the mean scores were 
29. 38 for the experimental group, and 21. 10 for 
the control group. This represents a mean gain 
of 14. 31 for the experimental group, and a mean 
gain of 3.76 for the control group. The experi- 
mental group then had a mean gainof 10. 55 words 
over the control group. 

The same table summarizes the findings for 
the sixth grade unit on Astronomy. In this unit 
of study the experimental group had a mean pre- 
test score of 15.68 while the control group hada 
mean pre-test score of 14.00. The finaltestfor 
the unit on Astronomy produced the following 
test scores: experimental group a mean 
score of 34. 84 and the control group a mean 
score of 21.72. The experimental group had 
a mean gain of 19. 16 while the control group 
had a mean gain of 7.72. The experimental 
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group then had a mean gain of 11. 44 words over 
the control group. 

In the unit of study, Sound, the experimental 
group hada meanpre-test score of 13.88 while the 
control group hada meanpre-test score of 15. 08. 
In the final tests the mean scores were 30. 72 for the 
experimental group and 21.52 for the control group. 
This represents a mean gain of 16.84 for the experi- 
mental group, anda mean gain of 6. 45 for the con- 
trolgroup. The experimentalgroup scored 10. 39 
more words per child over the control group. 

In the seventh grade on Air the experimental 
group had a mean pre-test score of 22.68 anda 
mean final test score of 35.68. This isa meangain 
of 13.00. Thecontrol group hada meanpre-test 
score of 19.80, and a mean final test score of 
24.16. Thecontrol group showed a meangain of 
4.36. This shows that the experimental group 
had a gain of 8. 64 over the control group. 

In the seventh grade unit of study on Soil the 
experimental group had a mean pre-test score of 
22.68, and a mean final test score of 34. 20. 
This is a mean gain of 11.56. The control group 
instead had a mean pre-test score of 21. 68, and 
a mean final test score of 25.48. This repre- 


sents a gain of 3. 84 for the control group. Com- 
paring the mean gains, the experimental group 
increased 7.72 over the control group: 

Table II summarizes the percentage of gain 


achieved by the experimental group over the con- 
trol group in the amount of vocabulary acquired 
by the boys and girls in these groups. 

What may be interpreted from the data present- 
ed in Table I? All experimental groups using the 
motion picture films and projected still pictur es 
had a range of mean scores from 6.90 to 11.44 
words gained over the control groups. This indi- 
cated a large increase in words gained over the 
control groups. Thus it may be concluded that the 
children of this particular population acquired to 
a greater extent the vocabulary in a unit of study 
when motion picture films and projected still pic 
tures were introduced. 

Six months following the completion of the unit 
of study the boys and girls were given vocabu- 
lary tests on the particular unit so as to deter- 
mine the amount of vocabulary retained over this 
period of time. Table II] summarizes the re- 
sults achieved in the re-test vocabulary tests. 

A close examination of the re-test and final 
test scores shows that re-test scores of the e x- 
perimental group in the Rock and Astronomy 
units of study for the experimental groupandfor 
all the units of study of the control groups, the 
re-test scores were higher than the final test 
scores. There was a loss in retention for the ex- 
perimental group in only two of the units of study. 
The following may indicate reasons for this in- 
crease in scores: (1) the science program did 
not terminate following the experimental period. 
All classes continued with thescience instruc- 
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tional program, and throughout the instructional 
program Classes utilized many audio-visual ma- 
terials including films and projected still pic- 
tures. An examination of the units of study and 
audio-visual materials used following the experi- 
mental period show that some of the vocabular y 
words included in the vocabulary tests were used. 
This may account for the gains in the re-test vo- 
cabulary scores for both the control and exper i- 
mental groups. (2) During the period between 
the pre-test and the final test both science and so~ 
cial studies were taught as part of the dailyin- 
structional program. An attempt was made so as 
not to include social studies units which were 
closely allied or related to the science units of 
study. This procedure may eliminate to a cer- 
tain extent the duplical. »n of terms or vocabulary 
which may be included in the vocabulary tests, 
Following the final tests the social studies and 
science programs may be correlated, but in any 
case both classes received the sameor similar 
activities, 

An analysis was done so as to check on the 
possibilities that the experimental group gains 
could be accounted for by the presence of key 
words in the media to which the control group 
may not have had access. 

The sixth grade unit of study on Astronomy 
was chosen to study carefully the vocabulary in- 
cluded in the audio-visual materials which was 
identical to the vocabulary inthe test. Narra- 
tions of films and filmstrips were obtained. 
Many duplications of words were found, but on- 
ly 138 different words were included in audio- 
visual materials as compared to 250 words inthe 
vocabulary tests. This is 55% of the total num- 
ber of words included in the Astronomy voc a bu- 
lary tests. Of the 138 words only 14 were key 
words or only 28% of the 50 key words included 
in the test. 

An analysis of the data show that the experi - 
mental group and the control group had appr o xi- 
mately the same means in the pre-test, 4. 84for 
the experimental group, and 4. 08 for the control 
group. In the final test, the experimental group 
scored a mean of 11.50 while the control group 
scored a mean of 6.84. This is a mean gain of 
4.66 words over the control group. The total 
gains for the experimental group in this unit of 
study was 19. 16 on the entire test, whereas the 
gains on the key words was only 6. 66. 

If the gains from both the experimental and 
control group in the key words were subtracted 
from the mean gains achieved in the whole test, 
then the control group would have a mean gainof 
4.96 while the experimental group would have a 
mean gain of 12.50. These data show that the 
gains achieved by the experimental groups were 
not gained primarily from the showing of films 
and projected still pictures. Statedin another 
way, the gains achieved by the experimental 
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group were acquired from the totalinstructiona 
program rather than from the use of films and 
projected still pictures. Therefore, the gains 
achieved by the experimental group cannot be 
accounted for by the vocabulary included in the 
films and projected still pictures. 


Is There a Relationship Between the I.Q. andthe 
Child’s Gains in the Vocabulary Tests inthe Ex- 
perimental Group? 








The Pearson-Product-Moment Test for corre- 
lation was found between the child’s I.Q. score 
and the gains he achieved in the vocabulary tests. 
The vocabulary test gains were derived by sub- 
tracting the pre-test score from the final test 
score, In each of the units of study, the corre- 
lations obtained are shown in Table IV. 

In the units of study on Astronomy, Rocks, 
and Air, there is no relationship while inthe re- 
maining units of study, Electricity, Sound, and 
Soil, there is a slight relationship between I.Q. 
scores and gains achieved in the vocabulary tests. 
In conclusion, no definite relationship exists as 
tol. 2 scores and gains achieved in the vocab u- 
lary tests in any of the units of study on the fifth, 
sixth, and seventh grades. The foregoing con- 
clusion also means that the bright, average and 
slow child profited somewhat the same in this 
study, or stated in another way, the gains 
achieved in the vocabulary tests do not nec- 
essarily depend upon the intellectual level of the 
individual, 


Is There a Relationship Between the Standard- 
ized Reading Vocabulary Scores and the Gains 
Achieved in the Vocabulary Tests by the Exper- 
imental Groups ? 











To answer this question, the Pearson-Product- 
Moment Test of Correlation was obtained be- 
tween the standardized reading scores and the 
gains achieved in the vocabulary tests in this 
study. 

The data shows that in only two units of study 
(Rocks and Air) there is a definite correlation 
which exists between standardized reading vocab- 
ulary scores and the vocabulary test scores in 
this study. In the remaining four units of study 
there is only a slight relationship. 

Pupil and Teacher Reactions to Audio-Visual 
Materials. The reactions of pupils andteachers 
represent the subjective evaluation of the use of 
various audio-visual materials in the classroom. 
All of the teachers in the study point outthe in- 
trinsic value of the use of audio-visual materials 
in making for a more effective teaching-learning 
Situation. The following excerpts from the teach- 
er’'s written reactions emphasizes this point: 





‘*Audio~Visual devices are necessary ex- 
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periences for the children in order to 
gain the fullest appreciation ofthe 
concepts presented in any given unit of 
study. ’’ 


‘*..,.. greater enthusiasm for extensive 
and intensive study by the pupils. ’’ 


‘«.,.. projective aids developed a great- 
er interest and better understanding. ’’ 


‘«,...more voluntary suggestions for ad- 
ditional activities were forthcoming from 
students in the experimental group. ’’ 


Some of the students’ reactions are as follows: 


‘Films are better because things are 
illustrated, ’ 


‘We learned more because we could see 
what was meant instead of reading about 
it or hearing it alone. "’ 


‘‘Astronomy filmstrips are more inter- 
esting. They help me toget a better 
idea of what the book said. ’’ 


‘I Ll never forget how the layers of earth 
folded over, I just couldn’t understand 
that when we talked about it in class, but 
I get it right away from the film. ”’ 


The reports from both teachers and pupils in 
a Situation in which a limited number of audio- 
visual materials were employed isa negative one. 
An enthusiastic learning situation seemed tode- 
velop in the classroom situation in which several 
audio-visual methods were used. 


Conclusions 


1. Ali experimental groups using the motion pic- 
ture films and projected still pictures had a 
large increase in vocabulary gained over the 
control groups in all of the units of study. 

. Re-test scores of the experimental group in 
the Rock and Astronomy units of study were 
lower than the final test scores while inall the 
other units of study for the experimental group 
and for all the units of the controigroups, the 
re-test scores were higher than the final test 
scores. There was a loss in retentionfor the 
experimental group in only two of the units of 
Study. 

. No definite relationship seems to exist as to 
I.Q. scores and gains achieved in the vocabu- 
lary tests in any of the units of study on the 
fifth, sixth, and seventh grades. 

. In only two units of study (Rocks and Air) 
there is a definite correlation which exists 
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TABLE IV 


CORRELATIONS BETWEEN I.Q. SCORES AND GAINS ACHIEVED 
IN THE VOCABULARY TESTS BY THE EXPERIMENTAL 
GROUPS IN THE SCIENCE UNITS, GRADES 
FIVE, SIX, AND SEVEN 





Unit of Study Correlation 





Electricity . 38 
Rocks .O1 


Astronomy - 15 
Sound 21 


Soil  ) 
Air . 06 





TABLE V 


PEARSON PRODUCT-MOMENT TEST FOR CORRELATION BETWEEN 
READING VOCABULARY SCORES ON STANDARDIZED TESTS, 
AND'GAINS ACHIEVED IN THE VOCABULARY TESTS 
FOR ALL UNITS OF STUDY 





Unit of Study Correlation 





Electricity .18 
Rocks .54 


Astronomy .21 
Sound . 09 


Soil .18 
Air . 69 
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between standardized reading vocabulary 
scores and the vocabulary test scores inthis 
Study. In the remaining four units there is 
only a slight relationship. 

. All of the teachers in this study point out the 
intrinsic value of the use of audio-visual ma- 
terials in making for a more effective te ach- 
ing-learning situation. 

. The boys and girls participating inthis study 
point out that an instructional program which 
uses many audio-visual materials enhances 
the learning situation. 


Implications 


The implications of the findings of this study 
are presented in relation to the role of the six- 
teen millimeter film and projected pictures in 
science unit vocabulary learnings in grades five, 
Six, and seven. 

The fact that all of the experimental groups in 
grades five, six, and seven using sixteen milli- 
meter films and projected still pictures had a 
large increase in vocabulary learnings as com- 
pared to the control groups in all of the units of 
study indicates that these materials should be giv- 
en serious consideration in a science program 
aimed at vocabulary growth. It must be repeat- 
ed that the experimental groups were compared 
not with a situation in which meager number of 
audio-visual materials were used, but rather 
with one in which several audio-visual materials 
were used except for the sixteen millimeter 
film and projected still pictures. This suggests 
that the instructional program should not be 
limited to the sixteen millimeter film and pro- 
jected still pictures, but should include a multi- 
ple number of audio-visual materials, i.e. 
blackboards, bulletin boards, charts, models, 
flat pictures, and field trips. All of these mate- 
rials carefully chosen and properly utilized 
should enhance the teaching-learning situation. 

One of the major objectives in the teaching of 
science is the development of important under- 
standings or concepts. These concepts are ex- 
pressed through word symbols, thatis, vocabu- 
lary. The ability to interpret word symbols may 
play an essential part in aiding comprehe ns ion 
and understanding of these concepts in science. 
This study may have important implications for 
the enrichment of the child’s basic science con- 
cepts. 

Teacher-training institutions have an ob liga- 
tion to train prospective teachers in the use ofa 
number of audio-visual materials in the instr uc- 


’ 
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tional program. Too often, beginning teachers 
limit their instructional program tothe use of 
one or two audio-visual materials rather thana 
number of them. If teacher-training institutions 
fail to help prospective teachers, then it is the 
responsibility of the school administrator ora 
designated person, such as the audio-visual 
chairman, to assist teachers in learning how to 
use the various audio-visual materials. Learn- 
ing how to operate the various projectors is im- 
portant, but even more important is learning how 
to use these materials in the instructional pro- 
gram. 

A program of instruction which includes a num- 
ber of audio-visual materials demans budgetary 
provisions for their purchase. School board 
members must be enlightened by their superin- 
tendent as to the intrinsic value of using audio- 
visual materials in the instructional program. 
All staff members should be encouraged through 
salary provisions to attend summer school and 
enroll in audio-visual courses. Arrangements 
should be made for teachers to attend audio-vis- 
ual institutes or workshops in which a broad a p- 
proach to instructional materials is used. 

The acquisition of vocabulary, one of the im- 
portant skills in reading, is a prerequisite toad- 
equate comprehension and interpretation in read- 
ing. The utilization of audio-visual materials 
enhances the acquisition and retention of vocabu- 
lary, and they should be included in the instr uc- 
tional program. 
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RELATION BETW EEN 


ENROLLMENT OF 


HIGH SCHOOLS FROM WHICH STUDENTS 
GRADUATED AND ACADEMIC ACHIEVE- 
MENT OF AGRICULTURAL STUDENTS, 
A. AND M. COLLEGE OF TEXAS’ 


JOHN R. BERTRAND** 
A. and M. College of Texas 


THE AGRICULTURAL and Mechanical C ol- 
lege of Texas, as a state supported educational 
institution, admits all white male students grad- 
uating with, at least, fifteen acceptable units 
from an accredited secondary school. One re- 
sult of this unselective admission is the enroll- 
ment of a number of students unprepared to do 
college level work.! A higher proportion of 
these unprepared students enroll in agricultural 
curricula than in arts and sciences or in engi- 
neering curricula. Student loss is heavy among 
these unprepared students. Thisarticle reports 
the results of a study of the relation between en- 
rollment of high schools from which students 
graduated, scores on aptitudes andachievemeit 
tests, and academic achievement of agricultur 
al students. 


Previous Research 


During the past thirty years, many studies 
have been made on forecasting college achi eve- 
ment. Some of these, with findings much the 
same as for other studies, have been on stu- 
dents of agriculture. High school grades and 
scores on various psychological tests have been 
the predictive measures used most often and 
grades given by the college teachers nearly al- 
ways have been the criterion of achievement. 
Scores on achievement tests administered at the 
time of college entry have been used in only 
a few cases as predictive measures of scholas- 
tic achievement of agricultural students. Pre- 
viously, little attention has been given to inves- 
tigating possible relations between enrollment 
of high schools from which students graduated, 





scores On aptitude and achievement tests and ac 
ademic achievement 


Sources of Information 


The over-all study of which this is apart was 
concerned with 637 non-transfer students who 
first enrolled as freshmen in agricultural curric- 
ula at the Agricultural and Mechanical College of 
Texas in 1946, 1947 and 1948, when because of 
overcrowded conditions on the main campus an 
annex was established to care for students dur 
ing their freshmen year. An additional 195 stu- 
dents, enrolling at the same time, were not stud- 
ied either because of non-comparability of 
course work or because of lack of essential infor- 
mation. Enrollments of high schools from which 
students graduated were available for 621 of the 
637 students with which most of the over-all 
study was concerned. For purposes of analyses, 
five enrollment categories were set up as follows: 
(1) under 150; (2) 150-249; (3) 250-499; (4) 500- 
999; and (5) 1000 and over. 

The measures used were: high school aver- 
age grade, the three scores (quantitative, lingu 
istic and total) from the A.C.E. Psychological 
Examination (1946 edition), and scores on the Co- 
operative Achievement tests in mechanics of ex- 
pression, reading, mathematics and science 
The criteria of achievement which were used 
were: grade point ratio? for all courses taken 
in English, in natural sciences, and in agr icul- 
ture by the end of the second year, andthe grade 
point ratio for the total of all courses taken by 
the end of the second year. 

In order to determine the relationship of en- 


* Adapted from writer's unpublished Ph.D. thesis, "Relation of Selected Social and Psychological Fac- 
tors to Academic Achievement of Students in the School of Agriculture, Agricultural and Mechanical 


College of Texas," Cornell University, 1950. 


Present address: College of Agriculture, University of Nevada, Reno, Nevada. 


In 1950, the A. and M. College of Texas established its Basic Division for the purpose of providing 
close supervision and assistance to all students during their period of transition from high school 
to college. 


Grade point ratio is determined at the A. ami M. College of Texas by dividing the total hours for 
which a student has been registered, whether passed or failed, into the total grade points earned. 
For each semester hour of credit which a course carries, the following grade point scale is used: 
As 33; Bw 2; C #2 1; Dw Of; and F » O;. However, for the purpose of this study, a negative 1 was as- 


signed for grades of F. 
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TABLE I 


RANGE OF GROSS SCORES, A.C.E. PSYCHOLOGICAL EXAMIN- 
ATION, LOCAL NORMS* QUARTILE CATEGORIES 





Quartiles Gross Scores 





Lowest Quartile Under 6&6 
Second Quartile 86 - 100 
Third Quartile 101 - 114 


Highest Quartile 115 and over 


*Unpublished data from the Office of the Registrar. N equals 1126 
entering, non-veteran students from the 1946-47 freshman class 
at the Agricultural and Mechanical College of Texas. 


TABLE II 


DISTRIBUTION OF 621 STUDENTS* BY ENROLLMENT OF HIGH SCHOOLS FROM 
WHICH STUDENTS GRADUATED AND A.C.E. PSYCHOLOGICAL EXAMINA- 
TILON QUARTILE CATEGORIES** 


Enrollmentof 
high schools Total no. In ACE In ACE In ACE In ACE 
from which stu- of lowest second third highest 
dents graduated Students quartile quartile quartile quartile 











~ Number of Students 


Under 150 154 87 . 7 
150 - 249 133 64 17 
250 - 499 159 74 20 
500 - 999 60 22 5 
1000 and over 115 28 14 

Total 621 275 6 63 





% of 
Percent of total in each enrollment group 


Under 150 24. 56. . 11.04 4.55 
150 - 249 21. 48. . 12.78 12.78 
250 - 499 25. 46. . 22.01 12. 58 
500 - 999 9. 66 36. , 26. 67 8.33 
1000 and over 18. 24. : 27.83 12.17 
Total 100. 44. 2! , 18. 84 10.15 








* Enrollment of high schools was unknown for 16 of the 637 students with which most 
of this study is concerned. 


**Agricultural Curricula, A. and M. College of Texas, 1946-48 entering classes at 
Annex. 
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rollment of high schools from which students 
graduated to achievement, when the effect of ap- 
titude is controlled, much of the analyses have 
been accomplished with tables which controlled 
the effects of aptitude as measured by gross 
scores on the A.C.E. Psychological Exam ina- 
tion. Quartile categories based upon local 
norms (Table 1) have been the means for con- 
trolling this score for purposes of comparisons. 


Findings 


Students graduating from high schools with 
enrollments of under 150 constituted 24. 80 per- 
cent of the total (Table II). Over one-half, 56.49 
percent, of the students from this category 
ranked in the lowest quartile on the A.C.E. Psy- 
chological Examination while a total of 84.41 per- 
cent ranked in the lowest and in the second quar- 
tiles combined. Only 4. 55 percent of the stu - 
dents ranked in the upper quartile. Students 
graduating from the large high schools with en- 
rollments of 1000 students or over were 18. 52 
percent of the total. About one-fourth, 24.35 
percent, of students in this category ranked in 
the lowest quartile. In the highest quartile were 
12.17 percent of the students in this large school 
category. Forty percent of the students from 
this large school category ranked in the com- 
bined third and highest aptitude quartiles. It 
may thus be seen that for the students inthis 
study, enrollment of high school was directly 
related to aptitude scores as measured by the 
A.C.E. Psychological Examination. 

The above generalization was further veri- 
fied by the mean scores on the A.C.E. Psycho- 
logical Examination (Table III). Students from 
the small high schools had a mean gross score 
of 82.49. There was an increase in the apti - 
tude gross score with each increase in size of 
high school. The highest average gross score 
for the group was 95.21. These students had 
graduated from the large high schools with en- 
rollments of 1000 and over. A study of the high 
‘school average grade presented in the same table 
reveals that the highest average grades in high 
school were earned by students graduating from 
small high schools. The average grade for stu- 
dents who graduated from high schools with en- 
rollments of under 150 was 83.81. Students 
from schools with enrollments of 150 to 249, in- 
clusively, had a high school average grade of 
32.44. These averages should be compared 
with the average of 41.50 for students from the 
large high schools having 1000 or more students 
enrolled. It appears that the low gross score 
for students from the small high schools was 
most greatly influenced by their poor showing 
on the linguistic portion of the A.C.E. Psycho- 
logical Examination. The mean L-score for 
students graduating from schools with enrol|l- 
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ments of under 150 was 46.92 as compared with 
a mean of 52..5 for students from the next cate 
gory and of 57. 40 for students from the large 
high schools. The range in scores was not near 
ly so great on the Q-score portion of this exam- 
ination as for the mean L-score. 

A comparison of mean scores on achievement 
tests, taken at the time of students’ entry into 
college, with enrollments of the high schools 
from which they graduated is significant in this 
study. Achievement scores for mechanics of ex 
pression (Table IV) had little relationship to en 
rollment of high school when the effect of the A 
C.E. Psychological Examination gross score was 
controlled by aptitude categories. Itcanbe clear 
ly seen that students ranking in the thirdand high 
est quartiles and who were from the small high 
schools had a larger mean achievement score in 
mechanics of expression. At the same time itis 
to be remembered that a much smaller percent 
age of students from the small schools were in 
these two higher quartile categories 

In the case of reading achievement (Table IV), 
again there seemed to be little relationship be 
tween mean scores and enrollmentof high schools 
when aptitude was controlled. Students from the 
two smaller school groupings, who also ranked 
in the highest apptitude quartile, hada higher mean 
achievement score in reading than students who 
graduated from the large schools. It should be 
pointed out again that a much smaller percent of 
students from these small schools ranked in the 
highest aptitude quartile. 

Achievement scores in mathematics and sci 
ence at the time of students’ entry into college 
also had little relationship, when aptitude was 
controlled, to the enrollment of high schools from 
which students graduated (Table IV) 

Mean grade point ratios for all courses taken 
by the end of the second year appeared to be more 
directly related to aptitude than to enrollments of 
high schools from which students graduated (Ta 
ble V). Students in the lowest aptitude quartile 
and from the small high schools, however, had 
a higher mean grade point ratio in all courses 
taken than did students from the large high 
schools who were in the lowest aptitude quartile 
With fewer students in the highest quartile cate 
gory, the significance of their mean grade point 
ratios was less than that of the grade point ra 
tios of those in the lowest quartile. However, 
the enrollment of the high schools had little ap- 
parent uniform relationship to mean grade :point 
ratios. 

Mean grade point ratios for all courses in Eng 
lish taken by the end of the students’ second year 
in college (Table V) were also more closely re 
lated to aptitude than to size of high sc hools as 
measured by enrollment. In both the lowestand 
the second quartiles on aptitude, students from 
small high schools had slightly higher ratios than 
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TABLE Il 


HIGH SCHOOL AVERAGE GRADE AND MEAN SCORES ON A.C.E. PSY- 
CHOLOGICAL EXAMINATION FOR 621 STUDENTS BY ENROLLMENT 
OF HIGH SCHOOLS FROM WHICH STUDENTS GRADUATED* 





Enrollment of Mean scores on 
high schools High 

from whichstu- — school 
dents graduated av. grade L-score Q-score 











Under 150 83. , 48.92 33.52 


150 - 249 82.44 ; 52.85 34. 58 
250 - 499 .43 " 52. 54 37.13 
500 - 999 . 23 54.45 36. 08 
1000 and over 81.50 95.21 57. 40 37.72 


Total 82. 23 88.49 52.79 35. 70 


*Agricultural Curricula, A. and M. College of Texas, 1946-48 enter- 
ing classes at Annex. , 
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TABLE IV 


MEAN SCORES ON COOPERATIVE ACHIEVEMENT TESTS FOR 621 STU- 
DENTS* BY ENROLLMENT OF HIGH SCHOOLS FROM WHICH STU- 
DENTS GRADUATED AND A.C.E. PSYCHOLOGICAL EXAM- 
INATION QUARTILE CATEGORIES** 








Mean scores on cooperative achievement tests 


Enrollment of ee — 
high schools For ACE For ACE For ACE For ACE 
from whichstu- lowest second third highest 
dents graduated quartile quartile quartile quartile 








Mechanics of Expression 





Under 150 " .79 54.29 56. § 

150 - 249 , . 63 49.00 53. 

250 - 499 , +: 51.06 55. 

500 - 999 ; . 53 51.00 54. 
1000 and over , .41 50.72 


Reading* 

Under 150 ; 83 53.83 
150 - 249 F > 55. 20 
250 - 499 " ; 54. 64 
500 - 999 : : 54. 82 


1000 and over ‘ : 56. 33 





Mathematics 
Under 150 " 54.51 

150 - 249 ' 55.63 

250 - 499 4 55.17 

500 - 999 ‘ 53.18 
1000 and over ° 56.15 





Science 


Under 150 51.43 54.72 , 60. 
150 - 249 50. 70 55. 51 , 60. 
250 - 499 50. 88 55.77 , 59. 
500 - 999 53. 68 55.53 ; 61. 
1000 and over 51. 64 56. 37 59.13 59. 





* Scores on the reading achievement test were available for only 485 
of these students. 

**Agricultural Curricula, A. and M. College of Texas, 1946-48 Enter- 
ing classes at Annex. 
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did students from the large high schools. Stu- 
dents in the lowest quartile category from high 
schools with enrollments of under 150 hada mean 
grade point ratio of 0.06 as compared with a ra- 
tio of -0. 29 for students from high schools with 
enroliments of 1000 and over. Students in the 
second quartile category from the small schools 
had a mean grade point ratio of 0.863 as com- 
pared with a ratio of 0.41 for students graduat- 
ing from the large high schools. Mean grade 
point ratios for students in the highest quartile 
category had little uniform relationship to enroli- 
ment of high schools from which students gradu- 
ated 

Mean grade point ratios in all natural science 
courses taken by the end of the students’ second 
year in college were more closely Felated to ap- 
titude than to enrollment of high schools from 
which students graduated (Table V). However, 
students in the lowest aptitude quartile from the 
small schools had a mean grade point ratio of 
0.18 which was .48 points higher than the -0. 30 
grade point ratio for students from high schools 
with enrollments of 1000 and over. In the sec- 
ond aptitude quartile there also appears to have 
been a reasonably clear negative relationship 
between size of schools and mean grade point 
ratios. For the third and for the highest apti- 
tude quartiles there was no clear-cut relation- 
ship between enrollment of high schools and 
mean grade point ratios. 

For the first three aptitude quartiles a nega- 
tive relationship was apparent between enro11 - 
ment of high schools and mean grade point ra- 
tios in all agricultural courses taken by the end 
of the second year. For students in the lowest 
quartile who graduated from high schools with 
enrollments of less than 150, the mean grade 
point ratio was 1.17, while students inthe same 
quartile who graduated from the large high 
schools of 1000 or more enrollment hada grade 
point ratio of 0.47. Not so clearatrend was 
seen in the second and third quartiles, butsome 
of the same relationship was present. Inthe 
highest quartile no relationship was evident be- 
tween enroliment of high schools and mean grade 
point ratios in agricultural courses. There was 
a Clearer relationship existing between aptitude 
scores and mean grade point ratios in agric ul- 
tural courses than between sizes of high schools 
and mean grade point ratios. 

When students’ completion of the second year 
in college was used as a measure of academic 
success and compared with size of high schools, 
without controlling the effects of aptitude, it was 
seen that 62. 26 percent of students from the med 
ium sized schools with enrollments of 250 to 
499, inclusively, were successful (Table VI). 
The next highest rate of completion was by stu- 
dents graduating from the large highschools with 
enrollments of 1000 or over. While these were 
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the two highest rates of completion, there was 
no clear-cut relationship trend between high 

school enrollments and completion of the second 
year of college study. 

When the effect of aptitude was controlled, 
there still appeared to be no consistent trend 
which would make it possible to use size of high 
schoolas a basis for predicting scholastic 
survival in college. As has already been shown, 
enroliments of high schoois from which students 
graduated were related to scores onthe A.C.E. 
Psychological Examination. Aptitude scores have 
also been shown to be related to academic a- 
chievement. Only in this way was there a clear- 
cut relationship between size of high school and 
academic success as measured by completion of 
second year in college. Students in the lowest 
aptitude quartile had a second year comp]|etion 
rate of 42.91 percent, while 74.60 percent of the 
students ranking in the highest quartile complet- 
ed the second year. 

Completion of the second year is a quantita- 
tive measure of academic achievement. By add- 
ing the qualitative measure of mean grade point 
ratios at the end of the second year for all stu- 
dents completing the second year, the two meas- 
ures become more meaningful (Table VII). Be- 
cause of the small number of students in the high- 
est quartile coming from high schools with enroll- 
ment categories of under 150 and of 500 to 999, 
inclusively, the mean grade point ratios shown 
in Table VII for these two categories probably 
have little true meaning. 

Students in the lowest aptitude quartile who 
graduated from high schools with enrollments of 
under 150 had a mean grade point ratio in all 
courses taken by the end of the second year of 
1.17 while those from schools with enrollments 
of 1000 and over had a mean grade point ratio of 
0.74. Except for students ranking in the lowest 
aptitude quartile, there was little consistent re- 
lationship apparent between size of high school 
and mean grade point ratios. However, within 
each category for size of high school, there was 
a direct relationship between aptitude quartile 
categories and mean grade point ratios in 
all courses taken at the end of two years. 

No consistent relationship existed between 
the mean grade point ratio in all Englishcourses 
(Table VII) for students completing the second 
year and size of high schools from which the stu- 
dents graduated. As was true for the ratios in 
all courses taken, there was a direct re] ation- 
ship within each size of high school category be- 
tween mean grade point ratios in English and ap- 
titude quartile categories. Students from schools 
with less than 150 enrollment and who ranked in 
the lowest aptitude quartile were relatively less 
successful in English than in all courses taken, 
in natural science courses or in all agricultural 
courses. 
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TABLE V 


MEAN GRADE POINT RATIOS AT END OF SECOND YEAR FOR 621 
STUDENTS BY ENROLLMENT OF HIGH SCHOOLS FROM WHICH 
STUDENTS GRADUATED, AND A.C.E. PSYCHOLOGICAL EX- 
AMINATION QUARTILE CATEGORIES * 








Mean grade point ratios at end of second year 


Enrollment of - 
high schools For ACE For ACE For ACE For ACE 
from which stu- lowest second third highest 
dents graduated quartile quartile quartile quartile 








In all courses taken 





Under 150 ‘ 0.94 ' 1. 20 

150 - 249 3 0. 88 , 1.59 

250 - 499 ; 0.94 a 1.33 

500 - 999 . 0. 88 ‘ 1. 38 
1000 and over , 0.77 


In English courses 





Under 150 A 0.83 1. 28 
150 - 249 ‘ 0.79 0.79 
250 - 499 ; 0.41 0.75 
500 - 999 ' 0.35 1.24 
1000 and over 3 0.41 0. 85 


In Natural Science courses 





Under 150 ’ 0.72 1.29 1.24 
150 - 249 " 0.51 0.57 1.45 
250 - 499 , 0. 64 0.97 1.05 
500 - 999 ; 0. 36 1.01 0.92 
1000 and over " 0.53 0. 87 


In Agricultural courses 


Under 150 " 1. 57 2.02 1.83 
150 - 249 : 1. 32 1.50 1. 81 
250 - 499 " 1.45 1. 62 1. 50 
500 - 999 ; 1.51 1.61 1. 67 
1000 and over , 1.23 1.53 1.89 








*Agricultural Curricula, A. and M. College of Texas, 1946-48 Enter- 
ing classes at Annex. 
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TABLE VI 


DISTRIBUTION OF 352 STUDENTS* COMPLETING SECOND YEAR BY ENROLI - 
MENT OF HIGH SCHOOLS FROM WHICH STUDENTS GRADUATED, AND BY 
A.C.E. PSYCHOLOGICAL EXAMINATION QUARTILE CATEGORIES** 





Enrollment of 

high schools In ACE In ACE In ACE In ACE 
from whichstu- Total lowest second third highest 
dents graduated No. quartile quartile quartile quartile 





Number completing second year 


Under 150 83 27 
150 - 249 70 j 20 
250 - 499 99 24 
500 - 999 31 7 
1000 and over 69 26 

Total 352 104 





Under 150 ’ 

150 - 249 52. 

250 - 499 62. 

500 - 999 51. 

1000 and over 60. 
Total 


* Enrollment of high schools was unknown for 9 out of the total of 361 students 
completing the second year. 

**Agricultural Curricula, A. and M. College of Texas, 1946-48 entering 
classes at Annex. 
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TABLE VII 


MEAN GRADE POINT RATIOS FOR 352 STUDENTS COMPLETING SEC - 
OND YEAR BY ENROLLMENT OF HIGH SCHOOLS FROM WHICH 
STUDENTS GRADUATED AND BY A.C.E. PSYCHOLOGICAL 
EXAMINATION QUARTILE CATEGORIES* 





— Mean grade point ratios at end of second year o_ 


high schools For ACE For ACE For ACE For ACE 
from which stu- lowest second third highest 
dents graduated quartile quartile quartile quartile 








In all courses taken 





Under 150 
150 - 249 
250 - 499 
500 - 999 
1000 and over 


In English courses 





Under 150 , 0.95 
150 - 249 , 0.99 
250 - 499 ' 0.52 
500 - 999 : 1.33 
1000 and over , 0.65 


Natural Science courses 


Under 150 ; 0.97 
150 - 249 , 1.02 
250 - 499 . 0.81 
500 - 999 , 1.48 
1000 and over ‘ 0. 80 





Agricultural courses 





Under 150 

150 - 249 

250 - 499 

500 - 999 . ‘ 
1000 and over , ; 1. 76 





*Agricultural Curricula, A. and M. College of Texas, 1946-48 enter - 
ing classes at Annex. 
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Mean grade point ratios in all natural sci 
ence courses taken by students completing the 
second year had little consistent relationship 
with size of high schools from which students 
graduated (Table VII), but these ratios appeared 
to be directly related to aptitude quartile cate- 
gories within each grouping for enrollment of 
high schools. 

For students completing the second year, 
little consistent relationship was found between 
either size of high schools or aptitude quartile 
categories and mean grade point ratios inallag- 
ricultural courses taken during the two years. 


Summary 


Three points stand out in all the tables which 
have been presented to show the qualitative re- 
lationship to enrollment of high schools from 
which students graduated. With the exc eption 
of mean grade point ratios in English, the high- 
est grade point ratios made by students in the 
lowest aptitude quartile were made by students 
from small high schools with enrollments of un- 
der 150 students. With no exceptions, the low 
est mean grade point ratios shown by any cate- 
gory were made by students in the lowest quar 
tile from the large schools of 1000 or more en 
rollment. With few exceptions, the highest 
mean grade point ratios for any category were 
earned by students in the highest quartile who 
were from the large schools of 1000 and over 
enrollment. 
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CHILDREN’S THINKING IN THE PROCESS 
OF SUBTRACTION’ 


E. GLENADINE GIBB** 
Iowa State Teachers College 
Cedar Falls, lowa 


Purpose and Background 





THE PURPOSE of this study was to analyze 
children’s thoughts in solving mathematical 
problems involving the process of subtraction. 
More specifically, this investigation was under- 
taken to study children’s thinking during the 
‘‘intervening interval’’ between the time they are 
asked to solve a problem and that time when they 
present a solution in an effort to understand the 
way in which children perceive applications of 
the process of subtraction as the degree of ab- 
straction in the context of the number situation 
varies. 

In the past two decades such research stud- 
ies as made by McConnell (12), Thiele (21), and 
Swenson (20) on comparative methods of t each- 
ing found that a ‘‘meaning theory’’ of instruction 
yielded superior learning results. This theory, 
so named primarily from the fact that children 
‘‘shall see sense’’ in what they learn (1) empha- 
sizes methods of instruction which lead children 
to discover relationships and observe generali- 
zations. Present theories of the teaching of 
mathematics as presented in The Teaching of 
Arithmetic (15) and The Learning of Mathemat- 
ics Its Theory and Practice (14) place emphasis 
on making mathematics meaningful by providing 
children with experiences that will enable them 
to understand the mathematical concepts and 
their applications. 

Judd (9) has described two ways in whicha 
student may acquire a knowledge of what a pro- 
cess really means: (a) he may be given many 
situations in which the process is used and by a 
‘‘gradual process of abstraction and generaliza- 
tion arrive at an understanding of the process,’’ 
or (b) he may be given explicit instruction in the 
meaning of the process by the teacher which thus 
hastens his arrival at the understanding of the 
general idea. The latter has been used in our 
present instructional program for it has seemed 
the more economical of the two procedures. In 
such programs the child has been urged and per- 
haps too often compelled by his elders to learn 














rapidly and without regard for his native inter- 
ests a system of numbers consisting of abstract 
ideas. Little is known regarding the effect of 
this emphasis on ‘‘products of learning’’ upon 
the most efficient utilization of a child’s capacity 
to learn. However, if a child is to be guided ef- 
fectively in the development of mathematical con- 
cepts, then it seems necessary not only to ana- 
lyze the number system but also to carefully con- 
sider children’s ways of thinking. 

The importance of this two-fold consideration 
in the process of subtraction was treated by Judd 
(9). More recently, it has been noted by Swen- 
son (19) in a consideration of instructional pro- 
cedures in arithmetic for primary grade children 
and more specifically, by Van Engen (22) and Har- 
tung and others (5) in formulating a method of in- 
struction in this area. 

From an evolution of a number system to de- 
scribe the numerosity of objects, a concept of a 
number system has been developed apart from 
the context of collections of distinct objects. This 
abstract form has become independent of objects 
to be counted. Thus, if ag_, is the unique solu- 
tion of the equation x + a, = ag, then ag-., is the 
difference between ag and a,, Or ag-, = ag ~ a, 
This process of finding ag-, when ag and a, are 
given is defined as subtraction. When numbers 
of a system are associated in one-to-one corre- 
spondence with distinct groups of objects, as A,, 
As, and Ag-, respectively, subtraction becomes 
the process of finding the number associated with 
the difference of two groups, Ag andA,. Or it 
may be said to be the process of finding the other 
group, which when combined with A, will give 
Ag. In identifying applications in situations fa - 
miliar to children, one can show that theyare alli 
solved by the same mathematical process and 
that they are mathematically equivalent. 

Studies in concept formation as made by 
Piaget (16,17), Long and Welch (10, 11, 23, 24), 
Heidbreder (6,7) indicate that meaning is, at 
least in part, a function of experience. The lim- 
ited range of children’s experiences with mathe- 
matical concepts in contrast to those of adults 


* A summary of an unpublished dissertation submitted to the faculty of the Graduate School of the Univer- 
sity of Wisconsin in partial fulfillment of the requirements for the degree of Doctor of Philosophy. 
“The writer wishes to express her sincere and deep appreciation to Professor John R. Mayor, under whose 


direction the study was made, and to Professor Chester W. Harris, under whose guidance the experiment 
was designed, for the assistance ami encouragement given her. 
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suggests that children’s perception of quantita- 
tive situations might be much different from 
that of adults. Children, therefore, may not 
perceive the mathematical identity in varying 
applications of the process of subtraction. 

Thus, in the classroom if the teacher is pro- 
viding experiences in subtraction as she con- 
ceives of the concept and if a child is try- 
ing to understand the situation with a different 
concept of the process to be used, then it may 
well be expected that these conflicting ideas will 
cause the child to become confused. In a broad- 
er sense, if mathematical concepts and their 
applications are developed in the classrooms 
from the concepts of adults, and if children 
bring to those same situations immature and pos- 
sibly different concepts, then it may well be ex- 
pected that a chaotic learning experience will re- 
sult. 


Statement of the Problem 


This investigation was an effort to determine 
whether or not three problem situations to which 
the process of subtraction is applicable elicit 
different responses from children in selected 
second grades. 

In this study thinking has been regarded as 
the mental activity a subject uses in recognizing 
relationships among properties of objects and 
symbols. This mental activity was observed in- 
directly through responses given by children in 
relating their manner of solving selected prob- 
lems where the process of subtraction and the 
context of the problem were systematically var- 
ied. 

Three applications to which the process of 
subtraction is applicable were defined as: 
(1) take-away subtraction situations, which pre- 
sented the subject with a group from which a 
part was to be taken; (2) additive-subtrac- 
tion situations, which presented the subject with 
a part of a desired group to which another part 
must be added that the group might be obtained; 
and (3) comparative-subtraction situations, 
which presented the subject with two groups for 
which the difference in the numerosity of the 
groups was to be determined. 

The contexts, in which these applications 
were presented, were defined as three levels of 
abstraction—concrete, semi-concrete, and ab- 
stract—as commonly considered in the teaching 
of mathematics. (1) At the concrete level, the 
problem was presented in a context of small toys 
and other manipulative objects. (2) At the semi- 
concrete level, the problem was presented in a 
context of groups of circles and/or squares 
mounted on cards. (3) At the abstract level, 
the problem was presented in a context of lan- 
guage and number symbols. 

In this investigation children’s thinking dur- 
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ing the ‘‘intervening interval’’ between the time 
they were asked to solve a problem andthat time 
when they presented a solution was studied in an 
effort to understand the way in which children 
perceive applications of the process of subtrac- 
tion. In addition, the degree of abstraction in the 
context of the number situation was varied in test- 
ing the following null hypothesis: 


For young children, certain applications 
of subtraction do not present situations in 
which children respond differently. 


The principal questions which this study has 
attempted to answer are: 


1. Do these three applications of subtraction pre- 
sent situations in which young children re- 
spond differently? If so, in what ways are 
these differences evident? 

. Do the contexts in which the applications are 
presented influence the children’s responses 
to the problems? If so, in what ways are 
these influences evident? 

. Is one kind of context more appropriate for an 
application than another context? If so, in 
what way is one more appropriate than an- 
other? 


Since this was an exploratory study, no effort 
was made to control experience. Rather, this in- 
vestigation has attempted to analyze mental pro- 
cesses of a group of randomly selected second 
grade children in their solutions of problems in 
the categories as defined above. 


Design of the Investigation 





The Problems— For eachof the nine c om bina- 
tions of application and abstraction, nine number 
pairs were used in describing quantitative situa- 
tions familiar to children. These number pairs 
were selected at random from those subtraction 
facts whose minuends are less than ten and whose 
differences are more than one. That the nine 
problems for each combination might appear 
more than once in the investigation, each of the 
eighty-one problems appeared four times, thus 
making thirty-six problems for each type of situ- 
ation or three hundred twenty-four problems in 
the investigation. 

Small toys and other manipulative objects 
(blocks, marbles, pennies, nickels, jacks, balls, 
pencils, cards, cars, trucks, trains, balloons, 
whistles, paint brushes, and paints) were used 
in the concrete context. At the semi-conc rete 
level, each group was pictured by dark green pa- 
per circles or squares mounted ina linear ar- 
rangement on 5 x 8 white cards. For the abstract 
context, problems were written about the same 
descriptive materials with each of the number 
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pairs as used at the object level. These prob- 
lems were typewritten (primer type) on 5 x 8 
white cards. 

Although the nine number pairs appeared in 
the same order for each child, no child had the 
same sequence of types of problems, and for no 
child did any like application appear in two con- 
texts consecutively. 

The Children—Since each child was to work 
a problem in each of the nine combinations of 
application and abstraction, thirty-six children 
were selected from second grades in twenty- 
four graded schools (two or more teachers) |o- 
cated in East and West Districts, Dane County, 
Wisconsin. One to three children were random- 
ly selected from each school. 

These children ranged in intellectual ability 
from intelligence quotients of 83 to that of 162, 
according to scores on intelligence tests given 
in the respective schools. The mean of intelli- 
gence quotient scores for the group was approx- 
imately 114. As indicated by the occupations of 
the fathers, these children came from homes 
representing varying levels of socio-economic 
status. From the information given by the teach- 
er regarding the child’s background of exper- 
ience and success in arithmetic, it was noted 
that all thirty-six children had been taught the 
take-away method of subtraction. Furthermore, 
all had at least limited experience at the time of 
the interview with the applications of subtrac - 
tion used in this study. The kind and amount of 
number experiences varied considerably. 

The Interview— The writer, who conducted 
all interviews, and the subject were provided a 
room where they might work without inter rup - 
tion. Before the nine problems were presented, 
several problems were given to clarify any ques- 
tions the child might have concerning the relat- 
ing of the processes he used in solving the prob- 
lems. All problems were presented verbally, 
as the respective contexts were placed before 
the child. Following the giving of his ans wer, 
the child was asked to tell how he arrivedathis 
solution. 

All interviews were recorded on tape and 
were supplemented at the time of the interview 
by notes taken of observed behavior of the child 
while he worked. It was from these recorded 
interviews that an analysis was made of chil- 
dren’s responses to these nine types of prob- 
lems. 


Scoring Procedures and Statistical Techniques 





In making an analysis of the recorded inter- 
views, six variables, were defined in the follow- 
ing manner: 


Process was the manner of solving the problem 
with reference to the level of mathematical 
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procedure used to arrive ata solution (i.e., 
from simple forms of counting to the use of 
number facts). 

oe was the degree to which the idea 
of the problem was recognized. 

Equation was the level of development of the sub- 
traction equation ag., = ag - a,, inthe pro- 
cess of solving the problem. 

Solution was the adequacy of the response given 

~~ Tn answer to the question asked regarding the 
problem situation. 

Time was the length of the period from the con- 

~ Clusion of the verbal presentation to the giv- 
ing of the solution to the problem. 

Verbalization was the number of words used in 

~~ response to the question, ‘‘How did you find 

out?’’ 


Rules were formulated for assigning a num- 
ber to a level of difficulty of the property consid- 
ered. A measurement for each property on each 
of the three hundred twenty-four problems was 
thus given. Three persons were asked to 
serve as judges in scoring fifty interviews ran- 
domly selected from the three hundred twenty- 
four interviews. These judges were in agree 
ment on approximately seventy-five percent of 
the scores with those given by the writer and at 
least two judges were in agreement On about 
ninety-one percent of the scores. The writer 
re-scored this same sample and was inninety- 
nine percent agreement with the original scores 
she had given. 

The present investigation was so designed that 
an application of the technique of the analysis of 
variance might be used in testing the hypothesis. 
The mathematical model appropriate for this an- 
alysis was one in which both systematic and ran- 
dom variation are considered since applications, 
contexts, and variables for scoring were sources 
of systematic variation and variation assignable 
to children a source of random variation. Thus 
the mixed model was used in the analysis of the 
composite score (sum of five variables, exclud- 
ing verbalization). For the analysis‘of each of 
the six variables the simple linear regression 
model was used. A 3 x 3 x 36 randomized block 
design with one observation per cell was usedfor 
each of these analyses. Where each of the five 
variables were regarded as a fourth dimension, 
a four-factor analysis was made. 

Since there was only one observation per cell, 
there was no estimate of error from withincells. 
Thus, the three-factor interaction sum of 
squares was used in its place. Where only an 
overall analysis of variation contributed by the 
components was made, main effects and inter- 
action effects were tested against the second- 
order interaction effect in the three-factor anal- 
ysis, and against the third-order interaction 
effect in the four-factor analysis. Models used 
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in the estimation of components of variance are 
found in papers by Johnson and Keeping (8), 
Crump (2), Daniels (3), and Satterthwaite (18). 
However, the particular approximate test used 
in this investigation for components of variance 
was that described by Mood (13). The sum of 
squares for the triple interactions, as well as 
for the third-order interaction was found by di- 
rect calculation as described by Edwards (4). 

In all analyses the one percent level of signif- 
icance was used for the rejection of the hypothe- 
sis involved. 


Analysis of Results 


Analyses were made of the variation (a) ac- 
cording to a composite score, a linear combina- 
tion of five scores taken from the interviews— 
namely, process, understanding, equation, so- 
lution, and time; (b) according to each of the six 
variables considered independently; and (c) ac- 
cording to five variables which were no doubt 
correlated, considered as a group. Standard 
scores were used for analyses in (a) and(c) and 
raw scores were used for analyses in (b). 

In Table I-A the analysis of variance of the 
behavior as represented by a composite score 
of the five variables is given. From this analy- 
sis one observes significant main effects in ap- 
plications, contexts, and individuals (children) 
and in the interaction of individuals with both 
applications and contexts. There was no signif- 
icant interaction between applications and con- 
texts. In all cases these hypotheses are state- 
ments in the form of null hypotheses. 

In Table I-B the main effects (applications, 
contexts, individuals) have been compared with 
two-factor interactions rather than with the tri- 
ple interactions as was done to obtain the results 
in Table I-A. The rationale for the second com- 
parison as given in Table I-B follows. It was 
observed in Table I-A that the null hypothesis 
was rejected for Ax 1, namely, that applica- 
tions and individuals do not produce effects to- 
gether which are not produced independ-ntly. 
Consequently, if interactions and applications 
were of the same order of magnitude, then one 
could not be assured that there was a difference 
between applications. In consequence, app lica- 
tion differences are important if they are large 
relative to applications~individuals interaction. 
Similarly, context and application differences 
are important if they are large relative to inter- 
action effects. From Table I-B it is noted that 
the application differences are most important 
against interaction. 

A similar analysis of variance for each of 
the variables—process, understanding, equation, 
solution, time, and verbalization was made. Ta- 
ble II presents the analyses of variance for each 
of these six variables. Summarizing these anal- 
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yses, differences do exist among the applica- 
tions and among the contexts for each of the var- 
iables, excluding verbalization. One observes 
no significant interaction between applications 
and contexts for any variable inany analysis. 
However, again excluding verbalization, there is 
significant interaction between applications and 
individuals for all variables. Significant inter- 
action between contexts and individuals was pres- 
ent only in the equation used and in the time tak- : 
en to arrive at a solution. 

In the four-way design (5 x 3 x 3 x 36) an anal- 
ysis of variance was made of the variables, ap- 
plications, contexts, and individuals (children). 
From this analysis, presented in Table III, one 
observes significant differences among app lica- 
tions, among contexts, and among individuals. 
No significant interaction effects are observed 
between cither applications or variables withcon- 
texts. However, there are observed significant 
interaction effects between individuals with con- 
texts, applications, and variables, respectively. 
Too, there is significant interaction between ap- 
plications and variables. Only one significant 
triple interaction is observed, that of applications, 
contexts, and individuals. All other triple inter- 
actions were combined with the interactions of 
variables, individuals, contexts, and applica- 
tions. Main effects and other interactions were 
then tested against this combined group. 

The Findings—For those analyses in which 
the null hypotheses regarding applications and 
contexts were rejected, a comparison was made 
between the three applications and the three con- 
texts. The findings follow: 


Applications 


1. Composite behavior: Take-away problems ap- 
peared easiest and comparative problems 
most difficult if the degree of difficulty of a 
problem may be said to vary inversely with 
the level of performance, that is, for prob- 
lems less difficult a higher degree of perforn.- 
ance may be expected while for problems more 
difficult a lower degree of performance is 
expected. 





. Understanding: The lack of understanding for 
comparative problems was observed in partic- 
ular during the interviews. For example, 
when a child was presented with eight forks 
and five knives and the question, ‘‘How many 
more forks do you see than knives?’’ the re- 
sponse was commonly, ‘‘Eight forks. ’’ 





3. Equation: Approximately three-fourths of the 
take-away problems were solved by the equa~ 
tion, ag-, = as - a, while the remaining one- 
fourth was almost equally divided between the 
use of the equation of the form a, + ag-, = ag 
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and by means of no identifiable equation. 
Three-fourths of the additive problems were 
solved by the addition equation and one-eighth 
of them by the subtraction equation. Approx- 
imately thirty-eight percent of the com pari- 
tive problems were solved by use of the sub- 
traction equation, about thirty percent by the 
addition equation, and twenty-five percent by 
means such that no equation could be ident- 
ified. The remainder of the problems were 
not attempted. 

In eighty-one percent of the take-away 
problems the equation was inferred from 
what was actually done or indicated as neces- 
sary to do (e.g., taking out) in order to solve 
the problem. Similarly, seventy-seven per- 
cent of the additive problems and eighty-two 
percent of the comparative problems were 
solved in terms of actively thinking with the 
groups (e.g., putting more on, one-to-one 
correspondence) rather than in terms of the 
mathematical symbols. 


. Solution: A higher degree of rightness of so- 
ution was given for take-away problems than 
for the other kinds of problems. Most incor- 
rect solutions were given to problems involv- 
ing comparative situations. 


. Time: Additive problems required a slightly 
longer period of time than comparative p r ob- 
lems but both took a longer period of time 
than did the take-away problems. 


Summary —There were significant differences 
among applications for the understanding, equa- 
tion, solution, and time scores. Highest degree 
of attainment was made in take-away problems 
and lowest level of attainment was made for com- 
parative problems. Additive problems were 
found to take a longer period of time for solution 
and were farthest removed from the generaliza- 
tion of the subtraction process being distinct 
from addition. Thus, for seven-year-old chil- 
dren, types of subtraction problems do not ap- 
pear mathematically or psychologically the same. 


Contexts 


. Composite behavior: There was an indication 
of a higher level of performance for problems 
which were presented with stimuli in the form 
of squares and/or circles mounted on car ds. 
By the same measurement there was indica- 
tion that the abstract contexts were found to 
be the most difficult. 





. Understanding: Problems presented with pic- 
ture stimuli were slightly easier to com pre- 
hend and problems presented without direct 
reference to objects and pictures were most 








difficult to comprehend. 


. Equation: For problems presented in an ab- 
stract context, the subtraction equation was 
used approximately twice as often as the ad 
dition equation. For ninety-five percent of 
the problems presented with objects, the 
child’s account of what he did made reference 
to actively taking a group away or putting 
more on as the means of solving the problem. 
This was also the situation from some eighty- 
seven percent of the problems presented with 
squares and circles and seventy-three percent 
of problems in abstract contexts. 

Some twenty-five percent of the problems 
classified according to context, were solved 
by means not identifiable in the form of an 
equation. For the remaining problems pre - 
sented in concrete and semi-concrete contexts, 
the equations a, + ag-, = ag and ag-., = ag - 
a,, were used approximately the same num- 
ber of times in solving problems in conc rete 
and semi-concrete contexts. 


. Solution: The use of object and picture stimu- 
Ii in presenting problems in this investigation 
was approximately equal in effectiveness for 
bringing about similar degrees of rightness of 
solution. 


. Time: Of the total time for the solution ofall 
problems, forty-three percent was used for 
problems presented with an abstract stimulus 
and fifty-seven percent for the object and pic - 
ture contexts combined. 


Summary— There were significant differences 
among contexts for levels of understanding, 
equation, solution, and time scores. Levels of 
performance for problems presented in semi - 
concrete contexts were higher than for those pre- 
sented in concrete contexts. However, lowest 
scores were made by responses given to prob- 
lems presented in abstract contexts. Therefore, 
contexts utilized in this study, semi-concr ete 
contexts are less difficult than concrete con- 
texts. Children have less difficulty solving prob- 
lems if they can manipulate objects or at least 
think in presence of objects with which the prob- 
lems are directly associated than when solving 
problems wholly on a verbal basis. 


Individuals 


There were significant differences among in- 
dividuals for all six measurements. Aninformal 
analysis suggested that two factors which may be 
related to this difference are intelligence and ex- 
perience. No attempt was made to identify the 
relationship or contribution of either to the re - 
sponses given. 
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Interactions 


. Observing the composite description of each 
response made to each application, in no 
case did all applications evoke the same be- 
havior from the same child. 


. These findings indicated that children indi- 
vidually pass through sequential Stages, or 
levels of the development of the mathemati- 
cal generalization of subtraction. 


. These children did not respond equally well to 
problems presented in varied contexts, that is, 
for children of this age there is no context in 
which problems appeared the same to all. 


. For no child were measurements similar for 
all variables. For the most part, each child 
was unique in the particular com binationof 
scores he received for his group of nine re- 
sponses. Thus, one score does not give a 
uniform picture of the child’s behavior in 
problem solving situations. Not only did dif- 
ferent children bring many varied proced- 
ures to problem solving situations, but also 
the same child used many varied procedures. 


. There were found no statistically significant 
differences in the interaction of applications 
andcontexts. For these children the applica - 
tions and contexts in which the applications 
were presented are independent of each other. 


}. There was significant interaction between ap- 
plications and individuals. Hence, this study 
gave no evidence of a general subtraction 
ability which characterizes children. 


. There was significant interaction between 
contexts and individuals. These children did 
not respond equally well to problems present- 
ed in similar contexts. 


. There was significant interaction between 
variables and individuals. No score gave a 
uniform picture of the child’s response to the 
problems and for no group of five or more 
children were there similarities among the 
pattern of scores for the different variables. 


. There was no significant interaction between 
variables and contexts; that is, the scores 
used were not more adapted to one kind of 
context than to another. 


. There was significant interaction between var- 
iables andapplications. The equation score in- 
dicated that comparative problems were more 
closely conceived as applicable of the process 
of subtraction than additive problems. This in- 
terpretation is in support of the first result 
above. 
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Conclusions 


Within the limitations of this exploratory in - 
vestigation the following conclusions were made. 

The principal conclusion, the one which an- 
swered the question raised by the null hypothesis, 
was that relatively young children with limited 
number experience gave different responses to 
problems involving three of the applications of 
subtraction. They do not as a groupconceive that 
one basic idea appears in all applications. Rather, 
they solved the problems in accordance with the 
reality of the problem situation. 

Furthermore, the kinds of materials (objects, 
pictures, words) used in the problem stimuli sug- 
gest different responses. Children were slightly 
more successful in the solutions of problems 
when they were solved in the presence of objects. 
According to the measures used inthis study, 
children more easily comprehended the problems 
and saw the applications in relation to the process 
of subtraction when problems were presented in 
semi-concrete contexts. Problems in either con- 
crete or semi-concrete contexts were less di ffi- 
cult than problems presented wholly on a verbal 
basis. For materials of the type used and meas- 
urements employed in this study, children were 
most successful in general overall problem solv- 
ing behavior with those problems, presented in 
semi-concrete contexts. . 

There was no context which appeared more 
appropriate to one application than to another. 


Suggestions for Further Research 





1. All results of this investigation may be said to 
relate to Such localities as Dane County, Wis- 
consin, where there exists a similar organiza- 
tion of school systems and the same philosophy 
of education. Findings for other types of local- 
ities are needed to support this study. 


. Additional evidence obtained from alterations 
of design would be desirable. The lack of rep- 
lication in the design used in this study has 
been recognized. 


. A longitudinal study, not only of group trends 
but also of case studies would give helpful in- 
formation concerning the evolving of the mathe- 
matical concept of subtraction. 


. The problem of the effectiveness of certain 
concrete materials in concept development 
seemed to be suggested by this study, raising 
the question as to whether or not certain kinds 
of materials detract from the basic concept to 
be developed. 


. Mathematical and psychological analyses of 
many other mathematical concepts are needed 
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if teachers of mathematics are to understand 
some of the problems that may confront their 
students in the formation of those concepts 
at various levels of deveiopment. 


. It is recognized that ways of studying c hil - 
dren's behavior in problem solving situations 
are crude. Research in that area as well as 
in the measurement of such behavior would 
contribute to the studies of mental processes. 
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AN EXPERIMENTAL STUDY OF CASE- 
DISCUSSION LEARNING 


LEONARD A. OSTLUND 
Kent State University 
Kent, Ohio 


I. The Problem 





THE PURPOSE of this study was to evaluate 
certain goals of the case-discussion method of 
teaching. The content of this type of course 
consists of problems in interpersonal relations 
which occur in the family, college and industry. 
Students are provided withcase-books and read 
ings and encouraged to participate inclassroom 
discussion. The teaching technique is larg ely 
non-directive, and the teacher attempts to seta 
permissive atmosphere in which each student 
will feel free to participate. 

The stimulus for this type of course was a 
seminar conducted by Wallace B. Donham, Dean 
of the Harvard Business School. The writer be- 
came intrigued by the Human Relations Course 
while teaching it at Colgate University with Dr. F. 
K. Berrien, Chairman of Human Re lations and 
author of Comments and Cases on Human Re la- 
tions (5). Asa result of aseminar with Dean 
Donham the writer became further interested. 





Il. History of the Problem 





A survey of the literature reveals that many edu- 
cators and psychologists have become interested 
in research concerning case-discussion teaching. 
Ingeneral, research has been in the ara of the lec- 
ture-discussion method of teaching vs. case dis- 
cussion teaching. This controversy has also been 
couched in terms of curriculum-centered vs. stu- 
dent-centeredtheory. The writer has contributed 
two research Studies of case-discussion classes 
which have raised problems that have been incor- 
porated in the present study (8), (9). 

A recent summary by Wispe has integrated 
much material concerning this controversy (12). 
In general, the traditionallecture method of 
teaching has proved useful in mastery of content, 
but apparently non-lecture methods do equally 
well. Concerning favorable changes in attitudes 
and interpersonal skills, non-lecture methods 
often prove superior to traditional lecture me th- 
ods. The non-lecture method effects chahges 
of attitudes in the direction of a positive va- 
lence for subject matter and alsotends to im- 
prove interpersonal skills. 





Ill. The Experimental Design 





The experimental and control groups were 
rigidly matched according to the following c har- 
acteristics; friendship, grade point average, 
class standing, and previous experience in case- 
discussion courses. The S.’s were initially con- 
tacted by means of a questionnaire circulated in 
the classroom with the consent of the teachers. 
On the basis of this information the groups were 
matched and each individual was telephoned by 
the writer. No coercion was used. TheS.’'s 
met in groups of six at the beginning of the term 
and again three months later. After the final 
meeting a general session of all participants 
was held, at which time the students were ac- 
quainted with further details of the project and 
there was a drawing for awards. The coopera- 
tion of the students and faculty throughout the 
study was exemplary. 

The experimental S. 's were drawn from case- 
discussion courses, whereas the control S.’s 
were drawn from non-case~-discussion c our ses. 
The experimental S.'s, during the period be- 
tween tests, were having experiences inthe case- 
discussion method of instruction, whereas the 
control group was not. Therefore, it would be 
appropriate to attribute changes which occurred 
in the experimental group to case- discussion 
learning, provided these changes didnot occur 
in the non-case-discussion learning group. Thus 
the control group functions as a constant frame 
of reference against which changes in the experi- 
mental group may be evaluated. Since the con- 
trol group has not had the experience of this s pe- 
cial educational training, we cannot expect any 
changes in their behavior. 

The control group thus provides a base-line as 
it were, againstwhich we may evaluate the prog- 
ress of the experimental group. We can determine 
whether they have been able to transfer their case- 
discussion learning to this new situation. This ex- 
perimentally created situation was purposely 
unstructured so that each 8. was provided with 
an equal opportunity to demonstrate any general 
increase in maturity of approach to the disc us- 
sionand solution of problems in interpersonal r e- 
lationships, which had occurred over this thr e e- 


* This paper was adapted from a thesis written for the Phe. degree at the University of Kansas, Law 
rence. The thesis committee comprised of Professors Fritz Heider, Marston McCluggage, Hilden Gibson, 


and the Chairman, Anthony Smith gave generoun assistance and my wife expedited every phase of the 
study. 
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month interval. The experimental design us ed 
in the present experiment has been repr od uced 
in Table I. 

The number of S.’s per group was held con- 
stant at six for each meeting. There were six 
experimental (case-discussion method) groups 
which met for two sessions, one at the beginning 
and one at the end of the semester. Six control 
(non-case-discussion method) groups did like- 
wise. The ‘‘after’’ sessions occurred three 
months later than the ‘‘before’’ sessions. The 
same S.'s came to the ‘‘before’’ and the ‘‘afte r’’ 
sessions and the personnel for each group was 
kept the same for both of these meetings. With 
few exceptions which were occasioned by drop- 
outs and refusals, almost all of the seventy-two 
S.’s each came to two, one-hour meetings. 

The Experimental Groups ~The experimental 
groups were chosen from four courses taught by 
the case-discussion method: Cases in Human 
Relations, Personnel Management, Cases inMar- 
riage and the Family, and Business Administra- 
tion Practices. The cases used in these courses 
all involve problems of interpersonal re lations. 
While the teachers differ in regard to age, exper- 
ience, and classroom technique, these courses 
spring from a common source~the seminars giv- 
en at the Harvard Business School by Dean Wal- 
lace B. Donham~and adhere to a commonset of 
underlying principles and methodology. 

There were six groups of experimental S.’s 
and each group met at the beginning and at the 
end of a semester. Each group consist edofsix 
S.’s who were drawn from different sections of 
the same course or from different case- dis cus- 
sion method courses, depending upon availability 
of the S.’s or their suitability in terms of the 
matching criteria. 

The Control Groups~The control group S.’s 
were drawn from classes whose students were 
registered in five different schools of the Univer- 
sity in order to gain an adequate sample of the 
‘‘average non-case-discussion course student.” 
These schools included the College of Liberal 
Arts, the School of Engineering, the School of 
Journalism, the School of Education, and the 
School of Business. 

It was felt that balancing the personnel within 
a control group of six non-case-discussion stu- 
dents by selecting them from different schools 
would prove more representative of ‘‘the aver- 
age non-case-discussion student.’’ Ther efore, 
each control group was arranged so that no more 
than two members, in each group of six S.’s, 
were from the same school. Moreover, these 
two individuals were chosenfrom different 
courses within the school. This arrangement 
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was possible because there was a wide range of 
non-case-discussion courses in each of these 
five schools. 

There were six groups of control S.’s, and 
each group of the same S.’s met at the beginning 
and at the end of a semester. Each group con- 
sisted of six S.’s who were drawn from differ- 
ent sections of the same course or from differ- 
ent non-case-discussion courses. 

The Number of S.’s Per Group~The choice of 
six S.’s per group was notan arbitrary one, 
but was governed by important considerations. 
Practical considerations involved the fact that 
the size of the group could not be too large, since 
not enough case-discussion courses were avail- 
able from which S. ’s could be drawnsothat the 
S.’s would come from a different section or 
course. Then too, the group could not be too 
large so that E., working alone, might not be 
able to observe all the interactions. However, 
if the groups were too small, the results would 
not be amenable to statisticaltreatment. Groups 
of six S.’s have been used by Bales (2), Stephan 
(10), and French (6), and have proved satisfac - 
tory. 

After the experimental procedure had been 
formulated, E. tried it out ina pilot study in 
order to become familiar with the routine and to 
discover whether the methodology would prove 
adequate. The pilot study proved useful in that 
it demonstrated the adequacy of some proced- 
ures and led to some fruitful modifications. 





IV. The Experimental Procedure 





Barker and Wright have called attention to 
the coerciveness of the behavior setting —the 
place in which behavior takes place (3:17). With 
this principle in mind, E. felt that discussion 
would be enhanced if it took place in anappropri- 
ate physical setting. Therefore, all meetings 
were held in a room which was regularly used 
for seminars and conferences. 

E. sat at one end of the table, the six S.’s 
sat at the other end, three facing three. This ar- 
rangement has been suggested by Bassand Klu- 
beck (4) and used by many investigators. S.’s 
were given identification numbers from one to 
six. These were placed on the table in front of 
them. There was no attempt to conceal the mi- 
crophone and recording equipment.* It was ex- 
plained that recording was necessary inorder to 
insure accurate data. E. kept a record ofallre- 
marks by noting the S.’s number andan identi- 
fying word. Playback of the recordings pe rmit- 
ted each conversation to be traced to its source 
and insured accurate transcription. 


* An Ekotape Tape eecorder and a Gray Audograph Disc recorder were used and proved satisfactory. 
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The leaderless group discussion technique 
was used. The S.’s were given the problem to 
read and then discussed it. Ansbacher(l), 
Bass (4), and others have foundthis a useful 
tool for assessing social skills of group discus- 
sion. The S.’s were strangers so that a ‘‘pure” 
informal group structure might emerge. 

There were several reasons for using the 
leaderless group discussion technique. Inthe 
first place, participation by E. would consti- 
tute a familiar experience for the case-discus- 
sion-experienced §8.’s, andthey might inter- 
act more freely than would the non-case-discus- 
sion S.’s. However, the non-case- discussion 
S.’s. would not be accustomed to the situation. 
Moreover, any participation in discussion by E. 
would have necessitated a standardized proc e d- 
ure, the same remarks would have had to be 
made in the same sequence for allgroups. This 
would have been impossible since E. was busy 
taking notes. 

As each 8. appeared for a session he was 
given a copy of a magazine to read while wait- 
ing. When the group had gathered E. collected 
the magazines, seated the S.’s and proceeded 
with the experiment. E. mentioned that the 
session was being tape recorded to insure ac- 
curacy, but that all information would be kept 
strictly confidential. E. placed numbers 
from one to six in front of each participant, ex- 
plaining that S.’s could be referred to by num- 
ber should anyone so desire. A ‘‘warm-up’’ 
case was distributed and discussed for five min- 
utes. At the conclusion of this disc us sion the 
first experimental case was distributed, read, 
and discussed for fifteen minutes* E. thensaid, 
“Write what you consider the best solution.’’ 
When this had been done the 8’s completed rat- 
ing scales concerning leadership in this partic- 
ular situation, Communication Data Forms, and 
stated their opinion of the problem. 

None of the twenty-four meetings was inter- 
rupted or interfered with in any way, and rap- 
port was excellent. Once begun, all groups pro- 
ceeded according to the standard methodology. 
The first group met in September, the last in 
May of the same year. The usualelapsed time 
for a group meeting was approximately fifty 
minutes, distributed as follows: 


Introductory remarks........... 5 minutes 
Problem I 5 minutes 
Problem II 

Written solution 10 minutes 
Forms and rating scales....... 10 minutes 





Concluding remarks 5 minutes 


V. The Evaluation Instruments 





A. The Communication Data Form 


On the Communication Data Form, the S. was 
asked to state those with whom he specifically 
tried to communicate verbally and whether or not 
he believed that he had been successful. He was 
also asked to state those whom he perceived as 
specifically trying to communicate with him ver- 
bally, and whether or not these attempts had been 
successful. 


B. The Leadership Rating Scale 


At the conclusion of the group discussion, 
each S. rated every member of the group, includ- 
ing himself, ona Leadership Rating Scale. TheS. 
was instructed to rate the members according to 
leadership in this particular situation. This 
made it possible to compare the perception of 
each member with the group’s perception. 


C. The Judgment of the Written Solutions 


The written solutions were typewritten on sep- 
arate pages, and presented in random order to 
eleven judges.** The judges were kept purposely 
unaware of the experiment. ‘‘The Badminton 
Problem’’ was used at all ‘‘before’’ sessions 
and ‘‘The Parasol Problem was used at all ‘‘af- 
ter’’ sessions. Since the judgmentcriteria for 
both problems differed only slightly, that for 
‘‘The Parasol Problem’’ has been omitted. 


1. ‘‘Centering’’ Category 





‘‘The Badminton Problem” was analyzed 
according to Wertheimer’s concept of “cen- 
tering’’. Wertheimer’s principle is that 
adequate problem-solving demands center- 
ing on the total situation. Wertheimer ex- 
plains centering as follows: 


‘‘Centering—the way one views the parts, 
the ‘items in a Situation, their meaning 
and role as determined in regardto a 
core, or radix—is a most powerful fac- 
tor in thinking. ’’ 

‘As to the concept of centering, it 
seems to be tacitly recognized that 


* The case used at all "before" sessions was "Two Boys Play at Badminton" (11, pel2j-126). At all "af- 
ter" sessions the case used was "The Parasol Problem" (7,p. 301-326). 


*vThe writer is indebted to the following individuals who served as judges: Graduate students: Dorothy 
Codkind, Kelly Wiltse, Charles Puchanan, Barry Crites, Charles Deeble, Granville Fairchild, Orville 
Harsch, Wendell Walker. Professors: Mary Kinnane, He Ke L'Ecuyer, Martin Scheerer. 
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adequate centering, with its consequen- 
ces for objectivity and justice is of the 
utmost importance’’ (11:136). 


Criteria 


. *fA’’ (older boy) centered 

. ‘*B’’ (younger boy) centered 

. Game or ‘‘both’’ centered 

. **Outside of the field’’ solution 














. ‘Inadequate Solutions’’ Category 





Rationale 


In his discussion of classroom research, 
Wertheimer pointed out that frequently the 
students handled the problem on a super fi- 
cial level, such as labeling behavior inster- 
eotypes, pronouncing moral judgments, and 
the like. The writer considered that such 
behaviors represented pitfalls or errors in 
problem-solving and this category was set 
up in order to detect such errors. 


Criteria 


. Pigeon-holing 

. Moralizing 

. Ignoring restrictions 

. Using a restricted frame of reference 
. ‘*Reinterpreting’’ facts 











. ‘*Means’’ Category 





Rationale 


By employing this category, E. endeav- 
ored to determine the underlying means 
with which the S. was attempting to cope 
with the situation. This index of behavior 
is important because it tells us muchabout 
the S.’s basic viewpoint toward inter pe r- 
sonal relations. 

Wertheimer was concernedabout the 
fundamental approach of individuals to 
problems in interpersonal relations. He 
described the typical modes of approach to 
‘‘The Badminton Problem’’ and stated that 
the following were the usual types of sug- 
gestions offered by his S.’s: Offering can- 
dy, playing another game, scolding, ignor- 
ing, coercing. (11:128). 

It will be noted that the categories which 
follow have been designed to encompass 
many of these suggestions which Wertheim- 
er has reported. 


Criteria 


a. Bargaining 
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. Bribing 

. Flattering 

. Shaming 

. Mutual means 
Withdrawal or quitting 








This was the last of the three categories 
designed for recording the solutions to “The 
Badminton Problem. ” 


Reliability of the Judges 





In the present study, each written solu- 
tion was judged independently by two differ- 
ent judges. Reliability was approached 
according to agreement per eachcategor y 
by both judges. Concerning ‘‘The Badmin- 
ton Problem’’ judges’ agreement was as fol- 
lows: ‘‘Centering’’ CriteriaAgr ee ment 
58 percent, ‘Inadequate Solutions” 
Criteria~Agreement 65 percent, “Means’’ 
Criteria~Agreement 55 percent. Concern- 
ing ‘‘The Parasol Problem’’, ‘‘Concrete 
Action Proposals’’ Criteria~Agreement 94 
percent, ‘‘Centering’’ Criteria~Agree- 
ment 66 percent, ‘‘Inadequate Solutions” 
Criteria~Agreement 57 percent, ‘‘Means’’ 
CriteriamAgreement 74 percent. While a 
higher degree of agreement would have 
been desirable, it should be pointed out 
that all agreement criteria were quite rig- 
orous, and the data was very difficult to 
judge. 


D. The Judgment of the Group Discussion Tran: 
scripts 


It will be remembered that each of the twenty- 
four experimental discussion sessions was tape 
recorded and transcribed. It ts true that a 
transcript is a reproduction of actual behavior 
and subject to limitations inherentin any fac- 
simile; however, these transcripts were made un- 
der rigorous experimental conditions, andit was 
not feasible to have observers present noting the 
interactions. 


Rationale 


The transcript judgment design in- 
volved counterbalancing inorder toaccount 
for three important variables which might 
bias judgment. They were: 


(1) The type of group, whether experimen- 
tal or control. 

(2) The time of discussion, whether ‘‘be- 
fore’’ or ‘‘after.’’ 

(3) The problem discussed, whether ‘‘The 
Badminton Problem’’ or ‘‘The Para- 
sol Problem. ’’ 
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As a preliminary measure, the judges 
were kept unaware of these threeaspects. 
Furthermore, each judge judged four 
transcripts ina prescribed order. The 
‘‘ABBA’’ sequence was used, in order to 
counterbalance the variables just men- 
tioned, 

As an additional precaution, each judge 
was told his set of four transcripts might 
include four, three, or two of one kind 
of group (experimental or control). Actu- 
ally, each judge received the four tran- 
scripts from one matched pair, namely: 
Experimental Group No. 1, ‘‘before’’ and 
‘‘after’’ sessions, and Control Group No.1, 
‘‘before’’ and ‘‘after’’ sessions. Itwas be- 
lieved that this combination of transcripts 
would result in the complete set of one 
matched group being judged in the same 
frame of reference. 

E. was very fortunate concerning the 
important problem of gaining the assist- 
ance of competent judges. Twelve mem- 
bers of the University of Kansas Staff vol- 
untarily gave generously of their time so 
that this task could be accomplished. Six 
of the judges were psychologists, six 
were teachers experienced in the case-dis- 
cussion method of teaching. * : 


Criteria 


The judges rated each of the four dis- 
cussion transcripts according to criteria 
generally accepted as indicative of group 
functioning. Ratings were made ona con- 
tinuum according to whether the group was 
‘thigh’’ or ‘‘low’’ on each variable. The 
seven variables judged were as follows: 
Insight, continuity, atmosphere, task-cen- 
teredness, group-centeredness, individual- 
centeredness, and success of communica-~ 
tion. 


Reliability of the Transcript Judgments 





With regard to agreement concerning 
type of group, neither the case-discussion 
teachers nor the psychologists who acted 
as judges proved superior in being able to 
judge whether or not the transcript was 
from a case-discussion or a non-case-dis-~ 
cussion group. Moreover, all of the 
judges were correct in their judgment con- 
cerning the ‘‘type of group’’ criteria more 
than half of the time. This may be inter- 
preted as indicating that the different types 
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of groups did not have outstanding dis tin- 
guishing characteristics and that neither 
type of judge proved clearly superior. 

Ccuncerning the seven continua ratings, 
agreement was analyzed by computing a 
Spearman Rank Difference Correlation 
Coefficient between the ranks assigned by 
the two judges to the seven variables. 
The results were an average Spearman 
Rank Difference Correlation Coefficient of 
.36. Thus reliability was low, andas was 
the case concerning the writtensolutions, 
either this type of material is difficult to 
judge or it was judged in different frames 
of reference 


VI. Analysis and Interpretation 





In this section the major findings from the 
present study will be analyzed and integration in- 
to a meaningful pattern. It should be pointed out 
that all the conditions and assumptions inher e nt 
in the use of the ‘‘t’’ test could not be met. Be- 
cause random sampling was not feasible, alter- 
native procedures were used. The universe of 
potential experimental subjects was relatively 
small so subjects were chosen in accordance 
with certain rigorous criteria, rather thanac- 
cording to personality or convenience. Control 
subjects who met the same criteria were chosen 
from a large pool ina random manner. Further- 
more, restrictions of time and scope limited the 
study to one college and a duration of one year. 
However, the ‘‘t’’ test was used because it 
seemed the most appropriate. The limitations 
which have been noted functioned to render the 
conclusions tentative. 

The Communication Data Analysis did not sup- 
port our hypothesis concerning the predicted su- 
periority of the case-discussion group, for the 
results indicated no significant differences. It 
may be that these skills are difficult to master, 
and that three months is not enough time for sig- 
nificant changes to occur. It is possible that 
this measure of communication was notadequate. 

The first discovery of differences between ex- 
perimental and control groups camefrom analy- 
sis of the ‘‘leadership’’ rating scale. It was 
found that there was no significant difference be- 
tween the groups pertaining to the perception of 
the individual S. vs. the groups’ perc eption of 
the ‘‘leadership’’ hierarchy. However, further 
analysis indicated that this may have been due to 
the fact that the range of ‘‘leadership’’ ratings 
for the experimental groups was much more nar- 
row than that of the control groups. It was de- 
termined that this difference was almost statis- 


* The writer is indebted to the following individuals who served as juiges: Professors Louise Barker, 
Lawrence Bee, Carroll Clark, Hilden Gibson, Fritz Heider, Marston McCluggage, Lee Meyerson, Edward 
Ge Nelson, William Thompson, Charles Warriner, Edward Wike, Me Erik Wright. 
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tically significant. (P. <.09). This was inter- 
preted as suggesting that the experimental groups 

had excelled the control groups in that the experi- 
mental groups tended to share leadership func- 
tions. This outcome was consistent with other 

predictions that were made. 

An analysis of the written solutions to ‘‘The 
Parasol Problem’’ provided four trends in the 
predicted direction, one contrary trend, andone 
inconclusive finding. None of these was statis - 
tically significant. The first trend involved at- 
tempts to keep the worker on the same work 
team. This may be interpreted as evincing a de- 
sire to contain the problem—to solve it with the 
minimum shifting or disturbance of personnel 
and interpersonal relationships. The second 
trend showed that the experimental group pro- 
duced more solutions that attempted to use the 
worker productively. This may be interpreted 
as demonstrating a desire to use the potential 
of the individual to bring satisfaction to the work- 
er and to the company. 

This inference is supported by the third tr end, 
in which the experimental group excelled the con- 
trol group by centering the problem in the most 
adequate manner. This may be interpreted as 
evidence that the experimental S.’s tended to 
take into account the total situation, rather than 
approach the problem from a restricted view- 
point. It will be remembered that Wertheimer 
emphasized the importance of centering by stat- 
ing that adequate problem-solving demanded ade- 
quate centering. 

The fourth trend in which the exper imental 
group demonstrated superiority was the finding 
that the experimental group produced fewer solu- 
tions that violated conditions which were stated 
in the problem. This was interpretedas meaning 
that the experimental S.’s were more willing to 
accept the limitations of the situation. It is gen- 
erally agreed that this is a more realistic ap- 
proach to problem-solving, than an approach 
which distorts the problem situationso that it 
may fit a particular solution. The latter ap- 
proach may be considered an evasion of the task. 

This last finding permits the resolution of al- 
ternate interpretations which were possible con- 
cerning the S.’s opinions of the problems. Our 
analysis indicated that the experimental S.’s 
voiced the criticism that relevant information 
was lacking more often than did the c ontrol S.’s. 
The alternative interpretation was proposed that 
either they were unwilling to accept the limita- 
tions of the situation, which was considered an 
unfruitful viewpoint, or that they keenly se nsed 
that important information was lacking, which was 
considered a reasonable criticism. The fourth 
trend supports the latter interpretation. By their 
behavior, in the task of writing solutions, the ex- 
perimental group demonstrated thatthey were 
willing to accept the limitations of the situa tion, 
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and their criticisms may be interpretedas mean- 
ing that they were more keenly aware of the lack 
of certain information than were the control 
group. 

In one respect the groups showed no differ- 
ences. Both achieved identical scores concern- 
ing inadequacies which were detected by the 
judges in their solutions. The one contrary 
trend stands out clearly. The experimental 
groups produced a greater number of solutions 
which involved retirement. This was consid- 
ered a drastic method of solving the problem 
since other alternatives were possible. It 
should be stated that no S. proposed retirement 
as the only solution, retirement was presented 
as an alternative. Therefore, it may have been 
considered as a last resort if other proposals 
failed. In this context, retirement is preferable 
to discharge, for retirement would be ne fit the 
worker by providing an income and 
would benefit the company by freeing 
them to hire a capable replacement. 
However, it would seem that the psy- 
chological repercussions —the impact 
on the worker and the effect of this action on 
company-worker relationships, — might out- 
weigh these benefits. 

The conclusion drawn from analysis of the 
written solutions was that the margins of super- 
iority of the experimental group were not large. 
This may be considered a reflection of the dif- 
ficulty of the problem. Perhaps we should not 
expect an individual to solve adequately a prob- 
lem which six individuals acting as a group have 
proved incapable of solving after fifteen minutes 
of discussion. This aspect of the study may be 
summarized by stating that the experimental 
group excelled the control group on four meas-~- 
ures, was excelled by the control group on one 
measure, and paralleled their performance on 
another one. 

In the matter of group discussion transcripts, 
there were no differences between groups on the 
variable that pertained to the emergence of a so- 
lution from the group discussion, and the adequa- 
cy of sucha solution—not one group achieveda 
solution, all ran out of time at the ‘‘after’’ ses- 
sion. On each of the remaining variables, the 
**t’’ tests and inspection of the relative mean 
gain differences indicated a consistent trend. 
The most striking finding of the present study 
was that the experimental group excelled the 
control group on each of the following seven var- 
iables: insight, continuity, atmosphere, task- 
centeredness, group-centeredness, individual- 
centeredness, and success of comm unication 
(Table II). Since it is generally agreed that 
these variables are crucial factors of group dis- 
cussion processes, this performance is impor - 
tant. The score for the variable, ‘‘atmosphere” 
was Statistically significant (P. <. 03). 
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It should be mentioned that one of these vari- 
ables, ‘‘insight’’ is more directly related to 
problem~solving than are the others. The mar- 
gin of excellence on ‘‘insight’’ was low, which 
seems consistent with the other low findings re- 
lated to problem-solving. The fact that the ex- 
perimental group functioned more adequately in 
group discussion processes indicates that they 
have made more progress in this direction than 
in the direction of group problem-solving. 

The transcript judgment analysis suggests 
that the overall performance of the experimental 
group surpasses that of the control group, that 
the former group has made more progress in 
group discussion skills. This is important, for 
it is generally agreed that these skills are pre- 
requisite to group problem-solving skills. 


Vi. 


Recommendations for Curriculum Change 





The fruitfulness of a study requires that it 
yields implications which extend beyond the ex- 
perimental situation. The writer trusts that the 
study will prove heuristic, and believes that the 
results warrant the suggestion of certain practi- 
cal applications and further experimental possi- 
bilities. 

In the matter of curriculum improvement, the 
data tend to give some support to the contention 
of other studies that case-discussion courses 
provide valuable experiences that are not usual- 
ly gained in the typical lecture method course. 
Concerning case-discussion courses of the 
Human Relations type, it seems thatit might 
prove profitable to extend the training period, 
alter the type of training, or effect some combi- 
nation of these possibilities. 

It often happens that training in case-discus- 
sion classes cannot afford all members equal op- 
portunities to learn group interaction process 
and group problem-solving skills because large 
enrollments curtail individual participation. Our 
results indicate that students need to become ac- 
customed to vis-a-vis relationships apart from 
the classroom situation, so thata transfer of 
learning will be effected to areas more within 
the scope of daily interpersonal relationships in 
college, in work, and in social situations. Un- 
less this happens, students may be content to 
permit the teacher to assume responsibility for 
furthering group interaction processes. Our re- 
sults seem to indicate thata promising begin- 
ning has been made, but there is no room for 
complacency, further progress is essential. 

Perhaps more participation, and experience 
in small groups could be managed by increasing 
the training period and instituting changes in 
methodology. Under the guidance of the teacher, 
a permissive atmosphere for classroom discus- 
sion could be established at the beginning of the 
course. Later, the classroom group could be 
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encouraged to institute its own observer-feed- 
back-evaluation procedure and these functions 
could be shared by the members. 

Concomitantly, students could be provided 
with experience in functioning as members of 
small groups, so that each individual would have 
a greater opportynity to function as a res ponsi- 
ble group member. The institution of small, 
leaderless groups would tend to maximize indi- 
vidual responsibility. It is hoped that these sug- 
gestions do not appear too unrealistic, at least 
some combination of these possibilities might 
prove feasible. Finally, if some of these sug- 
gestions were put into practice, further experi- 
mentation would become imperative in order to 
test the effectiveness of such procedures. 


VIII. Conclusion 





The gains made by the experimental group 
have been modest and they have been, with few 
exceptions, in the predicted direction. Statisti- 
cally only one of these gains was significant 
but this must be considered in the context of the 
situation in which they were accomplished. 

The experimental situation represented a 
novel experience that was a wide departure 
from classroom routine as practiced incase-dis- 
cussion method courses from which the experi- 
mental S.’s had been drawn. Moreover, there 
is evidence that ‘‘The Parasol Problem’’ which 
was the crucial test, was a very complex prob- 
lem. Finally, one must take into account the 
brevity of the training period—only three hours 
per week for three months~and the fact that this 
type of training was diametrically opposed to tra- 
ditional methods. 

When these conditions are taken into consider- 
ation, the writer believes it would be unrealistic 
to expect sweeping advances. In the writer’s 
opinion, an appreciation of these aspects leads 
one to conclude that these modest gains repre - 
sent an important achievement which may be at- 
tributed to the case-discussion method of 
teaching. 
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DO PROBATIONARY COLLEGE FRESHMEN 
BENEFIT FROM COMPULSORY STUDY 
SKILLS AND READING TRAINING? 


WALTER S. BLAKE, JR. 
University of Maryland 


WHEN THE facilities of the University of 
Maryland were extended to all prospective stu- 
dents below certification average in 1947, univer- 
sity policy dictated that students admitted with- 
out the certification average be put onprobation- 
ary status and given study and reading skills 
training. Asa result, the persistent and im- 
portant problem of how to assist college fresh- 
men make a good adjustment in the college 
melieu has received a great deal of attention 
at Maryland University*. 

The problems are multi-causaland therefore 
complicated, but not essentially differ ent than 
those faced by college freshmen before World 
War II2. At Maryland University, the problems 
have been made more acute by the ever-increas- 
ing number of applicants for admission, plus the 
mediocre quality of training being givenin too 
many of the primary and secondary schools in 
the states from which the University draws its 
students. Two types of students have been put 
on probation since the program’s beginning: (1) 
applicants for colleges demanding a higher level 
of academic achievement than high school 
records indicate will be attainable tc the appli- 
cants; and (2) students who are dropped from one 
college for scholastic deficiency and who wish to 
transfer to another degree-granting college upon 
being readmitted by the Committee on Admis- 
sions, Guidance, and Adjustment. If a student 
thus admitted fails to earna 2.0 (C) average 
over two semesters he remains on probation un- 
tilhe does earn the 2. 0 average. 

The Maryland program is unusual inthat few 
voluntary enrollees are accepted. Present facil- 
ities do not permit further expansion, although 
many requests for admission are received from 
non-probationers and/or their advisors. Upwards 
of 800 students are enrolled, representing every 
college on campus. Lectures and laboratory ses- 
sions comprise the first semester study skills 
course (College Aims I); combined lecture and 
laboratory experiences are used in the reading 
improvement course given the second semester 
(College Aims II). Tutoring in English, as well 
as Mathematics is offered the studentsand 





is available upon request of students. Remedial 

reading instruction and counseling interviews 

complete the program services, all of which are 

offered primarily to help students learn to work 
up to their capacities and effect a good social ad- 
justment in college and all their lives. 

In 1952-1953 the program was evaluated in an 
effort to determine, in part, whether proba tion- 
ary college freshmen do benefit from the compul- 
sory Study skills and reading-improvement train- 
ing. Two main areas were investigated; (1) the 
academic performance of students during and fol- 
lowing the training given; and (2) the students’ 
opinions of the program. The academic per- 
formance of the students was measured in sever~- 
always. The sociology grades of 128 probation- 
ers after training in study skills averaged 7 0. 47 
for one semester as compared to 75.60 for 122 
members of a control group. Reading tests re- 
vealed that the average reading speed of 139 pro- 
bationers was 247.3 words a minute before train- 
ing began, and had improved to 406. 0 at the con- 
clusion of the reading course, with comprehen- 
sion remaining practically unchanged. 

One follow-up study 3 was made todeterm ine 
the degree of academic success experienced by 
128 probationers and 122 control-group students, 
over a four and one-half year period. 22.6% of 
the probationers graduated in the 4-1/2 year per- 
iod as compared to 22. 9% of the control group. 
Also, of the original 128 probationers who at- 
tained the 2.0 (C) average necessary to enable 
them to get off probation, 47.3% went on to grad- 
uate (14.5% of this group was still in school at 
this writing.) 

A follow-up study of a second group of pr o ba- 
tioners is summed up in Table I. This table clear- 
ly indicates that a large number of lower-ranking 
members of the group do succeed. It wouldseem 
that the academic success of the probationers 
was considerable, at least partly due to the train- 
ing provided in the study and reading skills pro- 
gram. 

The anonymous student evaluation of the pro- 
gram was particularly enlightening. Students 
would rather be admitted on a non ~probationar y 


1. This article is based upon a doctoral stidy completed in 1953 by the author which is one of the 
bases for the textbook, College Orientation (2nd printing), coauthored with George Weigand, pub- 
Mey * 


lished by Prentice-Hall, 





2. Slaesser, “Villard W., and Everett 4. 4opkins, Counseling College Students During the Defense Period. 


Washington, "). Ces Office of Education, Feder 


ecurity Agency, via) 


3- “rs. Martha Maxwell, assistant to the director of the program, conducted this study. 
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rather than probationary basis when they apply 
for admission to a college or university, of 
course; but, once put on probation and required 
to complete a study skills and reading improve- 
ment program, do students then recognize that 
the experience has helped them? A systematic 
and entirely anonymous student evaluation was 
undertaken at the University of Maryland in an 
attempt to answer this question. Over aperiod 
of three semesters (1951-1953) 599 participants 
in the program were asked to evaluate their ex- 
periences anonymously: 72 were enrolled in a 
lecture class, and 340 were students in the lab- 
oratory of the study skills course;and the remain- 
ing 187 were in the reading improvement course. 

The lecture evaluation revealed that 54 of the 
72 members of the Spring, 1952, class were fa- 
vorably disposed to the lectures; 50 were inter- 
ested to the extent that they volunteered construc - 
tive suggestions to improve the lectures; and 
many could remember, and did write down the 
ways the lectures helped them. (There were 83 
such responses. ) 

The laboratory evaluation, involving 344 stu- 
dents over a period of three successive semes- 
ters (Fall, 1951-52 through Fall, 1952-53), indi- 
cated that only 20 students (5. 8%) felt they had 
received little or no help; 171 (49. 7%) indicated 
that the assistance they received was either 


‘‘considerable’’ or ‘‘great;’’ 143 (41.6%) felt 
they had received ‘‘some help;’’ only one felt 
that no help whatsoever had been received; 10 
(2. 9%) did not respond. Also 236 (68. 6%) stated 
that they were encouraged toinvestigate and at- 
tempt to solve their study problems as against 





BLAKE 93 


88 (25. 6%) who were not stimulated in this man- 
ner (5. &% did not volunteer comments in this 
area). 255 (71.2%) could remember, and did 

write down the laboratory periods whichhelped 

them most; and 131 (38. 0},) couldremember and 

did write down the laboratory periods which 

helped them least. 

The reading course evaluation, involving 187 
students over the Spring and Fall semesters of 
1952-1953, indicated that only 9 (4. 8%) felt they 
had received ‘‘little’’ help; while 122(59. 9%) 
stated that the help they had received was either 
“considerable’’ or ‘‘great;'’ and not one felt that 
he had received no help at all. 158 (84. 5°.) felt 
stimulated to investigate and attempt to solve 
their study problems, while 29 (15. 5%) were not 
stimulated in this manner or did not volunteer 
this type of response. Significantly, 138 (73. 8%) 
noted reading improvement in other univers ity 
courses; a total of 49 (26. 2%) either had no such 
experiences, or did not respond in this area. 

In summary, it seems evident that the stu- 
dents who were assigned to a probationary status, 
and were required to participate inthe University 
of Maryland study skills program, were benefit- 
ed academically. Also, the great majority rec-~ 
ognized and stated the benefits they felt they re- 
ceived despite the opportunity to be abusive which 
was open to every student in an anonymous evalu- 
ation of this sort. Inview of the findings re- 
viewed here it appears that the compulsory train- 
ing given students does help many achieve their 
immediate goals despite the stigmatization suf- 
fered in varying degrees by students when first 
placed on probation. 
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